[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:36 dist-test-slave-54kg krb5kdc[17433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:36 dist-test-slave-54kg krb5kdc[17433](info): set up 2 sockets
Sep 23 14:40:36 dist-test-slave-54kg krb5kdc[17433](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260923 14:40:37.912398 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.000s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:37 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:38.028342 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39585
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:38.132294 17446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:38.132517 17446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:38.132555 17446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:38.136301 17446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:38.136348 17446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:38.136366 17446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:38.136382 17446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:38.136396 17446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:38.141192 17446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:38.142074 17446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:38.143000 17446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:38.151057 17451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:38.151163 17452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:38.151065 17454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:38.151322 17446 server_base.cc:1034] running on GCE node
I20260923 14:40:38.151898 17446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:38.152818 17446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:38.153975 17446 hybrid_clock.cc:648] HybridClock initialized: now 1790174438153961 us; error 26 us; skew 500 ppm
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:38.156421 17446 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:38.157248 17446 webserver.cc:460] Webserver started at http://127.17.4.190:41475/ using document root <none> and password file <none>
I20260923 14:40:38.157793 17446 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:38.157878 17446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:38.158124 17446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:38.160173 17446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "5eecd29349b546ec832325e9f646615a"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "5d3c513db21a752a792ef2643ba1d5ba"
server_key_iv: "76b33b9988543895957793356d918924"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.160746 17446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "5eecd29349b546ec832325e9f646615a"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "5d3c513db21a752a792ef2643ba1d5ba"
server_key_iv: "76b33b9988543895957793356d918924"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.164163 17446 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:38.166283 17461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.167341 17446 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:38.167462 17446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "5eecd29349b546ec832325e9f646615a"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "5d3c513db21a752a792ef2643ba1d5ba"
server_key_iv: "76b33b9988543895957793356d918924"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.167552 17446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:38.179132 17446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:38.181787 17446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:38.182010 17446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:38.189134 17446 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:39585
I20260923 14:40:38.189157 17513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:39585 every 8 connection(s)
I20260923 14:40:38.190011 17446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:38.192589 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:38.193943 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 17446
I20260923 14:40:38.194094 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:38.195281 17426 external_mini_cluster.cc:1428] Setting key 77167b1798305f005304d84e118bff90
I20260923 14:40:38.198189 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a: Bootstrap starting.
I20260923 14:40:38.200649 17514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:38.201347 17514 log.cc:824] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:38.203082 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a: No bootstrap required, opened a new log
I20260923 14:40:38.206357 17514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eecd29349b546ec832325e9f646615a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39585 } }
I20260923 14:40:38.206573 17514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:38.206658 17514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eecd29349b546ec832325e9f646615a, State: Initialized, Role: FOLLOWER
I20260923 14:40:38.207058 17514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eecd29349b546ec832325e9f646615a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39585 } }
I20260923 14:40:38.207197 17514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:38.207279 17514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:38.207394 17514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:38.208295 17514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eecd29349b546ec832325e9f646615a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39585 } }
I20260923 14:40:38.208679 17514 leader_election.cc:302] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5eecd29349b546ec832325e9f646615a; no voters:
I20260923 14:40:38.208992 17514 leader_election.cc:288] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:38.209089 17519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:38.209286 17519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [term 1 LEADER]: Becoming Leader. State: Replica: 5eecd29349b546ec832325e9f646615a, State: Running, Role: LEADER
I20260923 14:40:38.209622 17519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eecd29349b546ec832325e9f646615a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39585 } }
I20260923 14:40:38.210317 17514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:38.211134 17520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5eecd29349b546ec832325e9f646615a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eecd29349b546ec832325e9f646615a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39585 } } }
I20260923 14:40:38.211280 17520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:38.211524 17520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eecd29349b546ec832325e9f646615a. Latest consensus state: current_term: 1 leader_uuid: "5eecd29349b546ec832325e9f646615a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eecd29349b546ec832325e9f646615a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39585 } } }
I20260923 14:40:38.211603 17520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:38.211971 17528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:38.215572 17528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:38.219409 17516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.198324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38850 (local address 127.17.4.190:39585)
0923 14:40:38.198699 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:38.198720 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:38.199696 (+ 976us) server_negotiation.cc:407] Connection header received
0923 14:40:38.202802 (+ 3106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:38.202816 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:38.203109 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:38.203436 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:38.205475 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.206406 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.207944 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.208421 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.208587 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.213545 (+ 4958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:38.213552 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:38.213567 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:38.213593 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:38.215690 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.216455 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.216460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.216465 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.216585 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.217007 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.217010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.217012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.217462 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:38.217650 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:38.218228 (+ 578us) server_negotiation.cc:299] Negotiation successful
0923 14:40:38.218484 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":115,"threads_started":1}
I20260923 14:40:38.221536 17528 catalog_manager.cc:1347] Generated new cluster ID: d9604c7b0c6a4e5f9f667e75dbc86988
I20260923 14:40:38.221591 17528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:38.234030 17528 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:38.234822 17528 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:38.242790 17528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5eecd29349b546ec832325e9f646615a: Generated new TSK 0
I20260923 14:40:38.243538 17528 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:38.278105 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39585
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:38.383690 17540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:38.383921 17540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:38.383986 17540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:38.387688 17540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:38.387735 17540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:38.387859 17540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:38.392787 17540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39585
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:38.393708 17540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:38.394625 17540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:38.403810 17548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:38.403855 17540 server_base.cc:1034] running on GCE node
W20260923 14:40:38.403828 17546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:38.403796 17545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:38.404433 17540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:38.405005 17540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:38.406193 17540 hybrid_clock.cc:648] HybridClock initialized: now 1790174438406182 us; error 26 us; skew 500 ppm
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:38.408778 17540 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:38.409567 17540 webserver.cc:460] Webserver started at http://127.17.4.129:32929/ using document root <none> and password file <none>
I20260923 14:40:38.410145 17540 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:38.410245 17540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:38.410444 17540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:38.412568 17540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "553436cdbe6e4208940fd47320b47b66"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "7e9191b71c54d44acc0daf876aacf380"
server_key_iv: "da062a69b9554232d8b0592aea8f7280"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.413165 17540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "553436cdbe6e4208940fd47320b47b66"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "7e9191b71c54d44acc0daf876aacf380"
server_key_iv: "da062a69b9554232d8b0592aea8f7280"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.416589 17540 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:38.418783 17555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.419925 17540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:38.420048 17540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "553436cdbe6e4208940fd47320b47b66"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "7e9191b71c54d44acc0daf876aacf380"
server_key_iv: "da062a69b9554232d8b0592aea8f7280"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.420151 17540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:38.437618 17540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:38.440388 17540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:38.440588 17540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:38.441157 17540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:38.441967 17540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:38.442039 17540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.442111 17540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:38.442163 17540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.450763 17540 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:35905
I20260923 14:40:38.450791 17668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:35905 every 8 connection(s)
I20260923 14:40:38.451547 17540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:40:38.453168 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 17540
I20260923 14:40:38.453305 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:38.453588 17426 external_mini_cluster.cc:1428] Setting key 54bbbb9d367efe60e62785ad4086d9aa
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:40:38.467515 17516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.453325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:41997 (local address 127.17.4.190:39585)
0923 14:40:38.453463 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:38.453468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:38.454304 (+ 836us) server_negotiation.cc:407] Connection header received
0923 14:40:38.455910 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:38.455913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:38.455961 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:38.456043 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:38.457393 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.458204 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.460033 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.460497 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.460596 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.464240 (+ 3644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:38.464242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:38.464244 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:38.464265 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:38.465462 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.465939 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.465997 (+ 58us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.465998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.466073 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.466416 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.466419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.466421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.466649 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:38.466761 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:38.467295 (+ 534us) server_negotiation.cc:299] Negotiation successful
0923 14:40:38.467397 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:40:38.468607 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.453716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39585 (local address 127.17.4.129:41997)
0923 14:40:38.454143 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:38.454210 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:38.455617 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:38.456214 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:38.456225 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:38.456739 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:38.457245 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:38.457258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.458337 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.458344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:38.459888 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:38.459903 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.460858 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.460864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:38.461101 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.461844 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:38.461866 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:38.464078 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:38.465559 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:38.465563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:38.465574 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:38.465837 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:38.466170 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:38.466174 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:38.466176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:38.466310 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:38.466761 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:38.466768 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:38.467027 (+ 259us) client_negotiation.cc:769] Sending connection context
0923 14:40:38.467231 (+ 204us) client_negotiation.cc:240] Negotiation successful
0923 14:40:38.467570 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":100,"threads_started":1}
I20260923 14:40:38.469868 17669 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39585
I20260923 14:40:38.470124 17669 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:38.470589 17669 heartbeater.cc:511] Master 127.17.4.190:39585 requested a full tablet report, sending...
I20260923 14:40:38.472177 17477 ts_manager.cc:194] Registered new tserver with Master: 553436cdbe6e4208940fd47320b47b66 (127.17.4.129:35905)
I20260923 14:40:38.473229 17477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:41997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:38.480679 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39585
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:38.584187 17674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:38.584466 17674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:38.584542 17674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:38.588325 17674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:38.588404 17674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:38.588491 17674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:38.593272 17674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39585
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:38.594172 17674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:38.595086 17674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:40:38.604441 17674 server_base.cc:1034] running on GCE node
W20260923 14:40:38.604405 17680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:38.604408 17679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:38.604437 17682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:38.605041 17674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:38.605651 17674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:38.606803 17674 hybrid_clock.cc:648] HybridClock initialized: now 1790174438606788 us; error 26 us; skew 500 ppm
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:38.609315 17674 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:38.610158 17674 webserver.cc:460] Webserver started at http://127.17.4.130:34253/ using document root <none> and password file <none>
I20260923 14:40:38.610688 17674 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:38.610782 17674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:38.610992 17674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:38.613066 17674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "0c16d24bb88748e4a79ed69d77c4c171"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "24e14842668d4af14d6ad3c493c23f3a"
server_key_iv: "93c21b2e43e13157db303094654f6953"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.613579 17674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "0c16d24bb88748e4a79ed69d77c4c171"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "24e14842668d4af14d6ad3c493c23f3a"
server_key_iv: "93c21b2e43e13157db303094654f6953"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.616793 17674 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:38.618958 17689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.620092 17674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:38.620205 17674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "0c16d24bb88748e4a79ed69d77c4c171"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "24e14842668d4af14d6ad3c493c23f3a"
server_key_iv: "93c21b2e43e13157db303094654f6953"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.620316 17674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:38.634645 17674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:38.637228 17674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:38.637428 17674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:38.637976 17674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:38.638716 17674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:38.638782 17674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.638844 17674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:38.638895 17674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.647193 17674 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:35957
I20260923 14:40:38.647217 17802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:35957 every 8 connection(s)
I20260923 14:40:38.648066 17674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:38.655544 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 17674
I20260923 14:40:38.655632 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:38.655921 17426 external_mini_cluster.cc:1428] Setting key 0ecb62684ca760db6740f9eeb9e81510
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:38.660445 17516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.649658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41195 (local address 127.17.4.190:39585)
0923 14:40:38.649802 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:38.649807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:38.650484 (+ 677us) server_negotiation.cc:407] Connection header received
0923 14:40:38.651604 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:38.651606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:38.651648 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:38.651712 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:38.652777 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.653286 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.654297 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.654478 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.654544 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.656831 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:38.656834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:38.656837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:38.656865 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:38.658319 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.658928 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.658942 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.658944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.659042 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.659360 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.659365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.659370 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.659537 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:38.659638 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:38.660185 (+ 547us) server_negotiation.cc:299] Negotiation successful
0923 14:40:38.660291 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:40:38.661130 17805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.649959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39585 (local address 127.17.4.130:41195)
0923 14:40:38.650333 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:38.650388 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:38.651423 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:38.651911 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:38.651917 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:38.652233 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:38.652655 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:38.652669 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.653388 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.653390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:38.654203 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:38.654211 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.654588 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.654590 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:38.654707 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.655184 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:38.655199 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:38.656694 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:38.658436 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:38.658445 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:38.658461 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:38.658827 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:38.659132 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:38.659135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:38.659137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:38.659267 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:38.659638 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:38.659645 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:38.659941 (+ 296us) client_negotiation.cc:769] Sending connection context
0923 14:40:38.660147 (+ 206us) client_negotiation.cc:240] Negotiation successful
0923 14:40:38.660428 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":87,"threads_started":1}
I20260923 14:40:38.662164 17803 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39585
I20260923 14:40:38.662410 17803 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:38.662979 17803 heartbeater.cc:511] Master 127.17.4.190:39585 requested a full tablet report, sending...
I20260923 14:40:38.664093 17477 ts_manager.cc:194] Registered new tserver with Master: 0c16d24bb88748e4a79ed69d77c4c171 (127.17.4.130:35957)
I20260923 14:40:38.664892 17477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:41195
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:38.683097 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39585
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:40777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:38.791561 17808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:38.791847 17808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:38.791915 17808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:38.795656 17808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:38.795696 17808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:38.795804 17808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:38.801357 17808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:40777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39585
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:38.802317 17808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:38.803299 17808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:38.812964 17816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:38.812958 17813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:38.813077 17808 server_base.cc:1034] running on GCE node
W20260923 14:40:38.812959 17814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:38.813637 17808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:38.814157 17808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:38.815303 17808 hybrid_clock.cc:648] HybridClock initialized: now 1790174438815287 us; error 26 us; skew 500 ppm
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:38.817920 17808 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:38.818756 17808 webserver.cc:460] Webserver started at http://127.17.4.131:39829/ using document root <none> and password file <none>
I20260923 14:40:38.819289 17808 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:38.819375 17808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:38.819586 17808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:38.821622 17808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "2aef556d05ac4cd1ae31a29bb91b604c"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "04249de28db799af12e74aa649ce8a8f"
server_key_iv: "26cfb86077395070ee2bb529b6339397"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.822180 17808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "2aef556d05ac4cd1ae31a29bb91b604c"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "04249de28db799af12e74aa649ce8a8f"
server_key_iv: "26cfb86077395070ee2bb529b6339397"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.825799 17808 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:40:38.828048 17823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.829115 17808 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:40:38.829241 17808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "2aef556d05ac4cd1ae31a29bb91b604c"
format_stamp: "Formatted at 2026-09-23 14:40:38 on dist-test-slave-54kg"
server_key: "04249de28db799af12e74aa649ce8a8f"
server_key_iv: "26cfb86077395070ee2bb529b6339397"
server_key_version: "encryptionkey@0"
I20260923 14:40:38.829355 17808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:38.843636 17808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:38.846138 17808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:38.846313 17808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:38.846848 17808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:38.847564 17808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:38.847630 17808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.847694 17808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:38.847741 17808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:38.856184 17808 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:44793
I20260923 14:40:38.856207 17936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:44793 every 8 connection(s)
I20260923 14:40:38.856909 17808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:38.858633 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 17808
I20260923 14:40:38.858749 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:40:38.858984 17426 external_mini_cluster.cc:1428] Setting key 2e0eb7c8a79db38538cd608c63e4a0a5
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:38.869554 17516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.858573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:37701 (local address 127.17.4.190:39585)
0923 14:40:38.858742 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:38.858749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:38.859501 (+ 752us) server_negotiation.cc:407] Connection header received
0923 14:40:38.860856 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:38.860860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:38.860926 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:38.860996 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:38.862131 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.862652 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.863958 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.864247 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.864362 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.866632 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:38.866635 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:38.866637 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:38.866656 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:38.867858 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.868315 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.868318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.868319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.868386 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.868663 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.868665 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.868666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.868826 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:38.868912 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:38.869369 (+ 457us) server_negotiation.cc:299] Negotiation successful
0923 14:40:38.869452 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 14:40:38.870307 17939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.858942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39585 (local address 127.17.4.131:37701)
0923 14:40:38.859355 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:38.859400 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:38.860640 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:38.861149 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:38.861155 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:38.861550 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:38.861988 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:38.862001 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.862772 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.862776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:38.863647 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:38.863655 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.864392 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.864396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:38.864563 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.865129 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:38.865144 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:38.866489 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:38.867968 (+ 1479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:38.867972 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:38.867982 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:38.868226 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:38.868463 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:38.868465 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:38.868466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:38.868592 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:38.868954 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:38.868958 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:38.869154 (+ 196us) client_negotiation.cc:769] Sending connection context
0923 14:40:38.869328 (+ 174us) client_negotiation.cc:240] Negotiation successful
0923 14:40:38.869533 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":118,"threads_started":1}
I20260923 14:40:38.871312 17937 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39585
I20260923 14:40:38.871496 17937 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:38.872036 17937 heartbeater.cc:511] Master 127.17.4.190:39585 requested a full tablet report, sending...
I20260923 14:40:38.873059 17478 ts_manager.cc:194] Registered new tserver with Master: 2aef556d05ac4cd1ae31a29bb91b604c (127.17.4.131:44793)
I20260923 14:40:38.873627 17478 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:37701
I20260923 14:40:38.884573 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:38.907939 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.899865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.17.4.129:35905)
0923 14:40:38.900161 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:38.900170 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:38.900190 (+ 20us) server_negotiation.cc:407] Connection header received
0923 14:40:38.900236 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:38.900240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:38.900403 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:38.900511 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:38.901097 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.901812 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.902590 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.902922 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.903000 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.905197 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:38.905204 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:38.905215 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:38.905237 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:38.906519 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.906862 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.906865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.906867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.906930 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.907126 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.907128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.907129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.907333 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:38.907473 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:38.907640 (+ 167us) server_negotiation.cc:299] Negotiation successful
0923 14:40:38.907749 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":97,"threads_started":1}
W20260923 14:40:38.908784 17583 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 14:40:38 dist-test-slave-54kg krb5kdc[17433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:38.933075 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:38.924853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51460 (local address 127.17.4.129:35905)
0923 14:40:38.925018 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:38.925022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:38.925173 (+ 151us) server_negotiation.cc:407] Connection header received
0923 14:40:38.925336 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:38.925339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:38.925381 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:38.925468 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:38.926126 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.926627 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.927404 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:38.927640 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:38.927743 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:38.929927 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:38.929931 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:38.929933 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:38.929956 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:38.931386 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.931856 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.931860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.931861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.931959 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:38.932255 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:38.932260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:38.932262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:38.932422 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:38.932554 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:38.932804 (+ 250us) server_negotiation.cc:299] Negotiation successful
0923 14:40:38.932919 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260923 14:40:38.934034 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 17540
I20260923 14:40:38.939730 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 17674
I20260923 14:40:38.945013 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 17808
I20260923 14:40:38.950349 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 17446
2026-09-23T14:40:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2067 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:39 dist-test-slave-54kg krb5kdc[17951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:39 dist-test-slave-54kg krb5kdc[17951](info): set up 2 sockets
Sep 23 14:40:39 dist-test-slave-54kg krb5kdc[17951](info): commencing operation
krb5kdc: starting...
W20260923 14:40:39.976372 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:40.088748 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:33395
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:33395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:40.191303 17964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:40.191540 17964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:40.191576 17964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:40.195453 17964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:40.195499 17964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:40.195518 17964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:40.195533 17964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:40.195574 17964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:40.200469 17964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:33395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:33395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:40.201364 17964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:40.202312 17964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:40.210227 17970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.210285 17972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.210424 17969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:40.210573 17964 server_base.cc:1034] running on GCE node
I20260923 14:40:40.211149 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:40.212172 17964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:40.213325 17964 hybrid_clock.cc:648] HybridClock initialized: now 1790174440213297 us; error 40 us; skew 500 ppm
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:40.215826 17964 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:40.216636 17964 webserver.cc:460] Webserver started at http://127.17.4.190:46759/ using document root <none> and password file <none>
I20260923 14:40:40.217147 17964 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:40.217231 17964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:40.217442 17964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:40.219324 17964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "4b638dac02ad4ea6a9e11828b91072d3"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "8c1c4ac8441405b6304ba2c34de99485"
server_key_iv: "1abf0016529fda6dd728104d1df7c07e"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.219909 17964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "4b638dac02ad4ea6a9e11828b91072d3"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "8c1c4ac8441405b6304ba2c34de99485"
server_key_iv: "1abf0016529fda6dd728104d1df7c07e"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.223325 17964 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:40.225474 17979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.226611 17964 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:40.226745 17964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "4b638dac02ad4ea6a9e11828b91072d3"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "8c1c4ac8441405b6304ba2c34de99485"
server_key_iv: "1abf0016529fda6dd728104d1df7c07e"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.226855 17964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:40.256628 17964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:40.259454 17964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:40.259649 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:40.266672 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:33395
I20260923 14:40:40.266693 18031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:33395 every 8 connection(s)
I20260923 14:40:40.267560 17964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:40.270233 18032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:40.273571 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 17964
I20260923 14:40:40.273690 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:40.273931 17426 external_mini_cluster.cc:1428] Setting key a63660e26e3e2f9c1a6188e967c3beaf
I20260923 14:40:40.275900 18032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3: Bootstrap starting.
I20260923 14:40:40.278189 18032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:40.279013 18032 log.cc:824] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:40.281057 18032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3: No bootstrap required, opened a new log
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:40.284101 18032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b638dac02ad4ea6a9e11828b91072d3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 33395 } }
I20260923 14:40:40.284322 18032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:40.284377 18032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b638dac02ad4ea6a9e11828b91072d3, State: Initialized, Role: FOLLOWER
I20260923 14:40:40.284760 18032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b638dac02ad4ea6a9e11828b91072d3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 33395 } }
I20260923 14:40:40.284869 18032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:40.284966 18032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:40.285082 18032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:40.285892 18032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b638dac02ad4ea6a9e11828b91072d3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 33395 } }
I20260923 14:40:40.286206 18032 leader_election.cc:302] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b638dac02ad4ea6a9e11828b91072d3; no voters:
I20260923 14:40:40.286520 18032 leader_election.cc:288] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:40.286589 18037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:40.286793 18037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [term 1 LEADER]: Becoming Leader. State: Replica: 4b638dac02ad4ea6a9e11828b91072d3, State: Running, Role: LEADER
I20260923 14:40:40.287117 18037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b638dac02ad4ea6a9e11828b91072d3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 33395 } }
I20260923 14:40:40.287714 18032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:40.288586 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.275169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41154 (local address 127.17.4.190:33395)
0923 14:40:40.275527 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:40.275541 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:40.275573 (+ 32us) server_negotiation.cc:407] Connection header received
0923 14:40:40.276201 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:40.276218 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:40.276508 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:40.276751 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:40.277546 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.278555 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.279676 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.280189 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.280304 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.282902 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:40.282907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:40.282918 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:40.282942 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:40.285348 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.285767 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.285773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.285778 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.285890 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.286173 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.286178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.286180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.286621 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:40.286822 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:40.287495 (+ 673us) server_negotiation.cc:299] Negotiation successful
0923 14:40:40.287703 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":119,"threads_started":1}
I20260923 14:40:40.288869 18039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b638dac02ad4ea6a9e11828b91072d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b638dac02ad4ea6a9e11828b91072d3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 33395 } } }
I20260923 14:40:40.288970 18039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:40.288631 18038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b638dac02ad4ea6a9e11828b91072d3. Latest consensus state: current_term: 1 leader_uuid: "4b638dac02ad4ea6a9e11828b91072d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b638dac02ad4ea6a9e11828b91072d3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 33395 } } }
I20260923 14:40:40.289271 18038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3 [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:40.290961 18046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:40.293540 18046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:40.299038 18046 catalog_manager.cc:1347] Generated new cluster ID: 0d14e68b4b114d94971c82ba10d268c1
I20260923 14:40:40.299206 18046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:40.308382 18046 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:40.309253 18046 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:40.314373 18046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b638dac02ad4ea6a9e11828b91072d3: Generated new TSK 0
I20260923 14:40:40.314997 18046 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:40.348484 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:33395
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:40.468715 18058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:40.469080 18058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:40.469158 18058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:40.473642 18058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:40.473693 18058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:40.473796 18058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:40.478868 18058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:33395
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:40.479918 18058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:40.480999 18058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:40.490103 18066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.490096 18064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:40.490201 18058 server_base.cc:1034] running on GCE node
W20260923 14:40:40.490115 18063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:40.490674 18058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:40.491331 18058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:40.492493 18058 hybrid_clock.cc:648] HybridClock initialized: now 1790174440492463 us; error 38 us; skew 500 ppm
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:40.495015 18058 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:40.495841 18058 webserver.cc:460] Webserver started at http://127.17.4.129:39075/ using document root <none> and password file <none>
I20260923 14:40:40.496408 18058 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:40.496496 18058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:40.496724 18058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:40.498684 18058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "748acf08da824f8782fd5986da00a142"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "cb8de5c892263dd37ff9aa34aa42de04"
server_key_iv: "f71ad8f3bb2574cfec65765f8b72bbfa"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.499248 18058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "748acf08da824f8782fd5986da00a142"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "cb8de5c892263dd37ff9aa34aa42de04"
server_key_iv: "f71ad8f3bb2574cfec65765f8b72bbfa"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.502794 18058 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:40:40.505129 18073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.506330 18058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:40:40.506482 18058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "748acf08da824f8782fd5986da00a142"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "cb8de5c892263dd37ff9aa34aa42de04"
server_key_iv: "f71ad8f3bb2574cfec65765f8b72bbfa"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.506589 18058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:40.524283 18058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:40.526800 18058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:40.526978 18058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:40.527724 18058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:40.528591 18058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:40.528669 18058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.528779 18058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:40.528829 18058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.537174 18058 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:40535
I20260923 14:40:40.537231 18186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:40535 every 8 connection(s)
I20260923 14:40:40.538051 18058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:40:40.544473 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18058
I20260923 14:40:40.544585 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:40.544852 17426 external_mini_cluster.cc:1428] Setting key e1a7cfe2b80c17f955d3801e8068f42e
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:40.550347 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.539658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:39837 (local address 127.17.4.190:33395)
0923 14:40:40.539834 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:40.539839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:40.540596 (+ 757us) server_negotiation.cc:407] Connection header received
0923 14:40:40.541359 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:40.541362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:40.541406 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:40.541481 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:40.542532 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.543065 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.544169 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.544521 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.544641 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.547069 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:40.547073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:40.547076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:40.547104 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:40.548461 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.548951 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.548955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.548957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.549033 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.549359 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.549362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.549364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.549534 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:40.549632 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:40.550055 (+ 423us) server_negotiation.cc:299] Negotiation successful
0923 14:40:40.550165 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 14:40:40.551074 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.540049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:33395 (local address 127.17.4.129:39837)
0923 14:40:40.540455 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:40.540493 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:40.541167 (+ 674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:40.541627 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:40.541634 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:40.541949 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:40.542404 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:40.542416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.543182 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.543184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:40.544070 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:40.544078 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.544701 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.544705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:40.544835 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.545542 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:40.545557 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:40.546919 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:40.548581 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:40.548588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:40.548600 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:40.548849 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:40.549124 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:40.549128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:40.549130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:40.549262 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:40.549629 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:40.549634 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:40.549850 (+ 216us) client_negotiation.cc:769] Sending connection context
0923 14:40:40.550016 (+ 166us) client_negotiation.cc:240] Negotiation successful
0923 14:40:40.550303 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":100,"threads_started":1}
I20260923 14:40:40.552211 18187 heartbeater.cc:347] Connected to a master server at 127.17.4.190:33395
I20260923 14:40:40.552449 18187 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:40.552883 18187 heartbeater.cc:511] Master 127.17.4.190:33395 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:40:40.554385 17996 ts_manager.cc:194] Registered new tserver with Master: 748acf08da824f8782fd5986da00a142 (127.17.4.129:40535)
I20260923 14:40:40.555611 17996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:39837
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:40.570776 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:33395
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:40.672256 18192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:40.672462 18192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:40.672502 18192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:40.676349 18192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:40.676398 18192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:40.676452 18192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:40.681970 18192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:33395
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:40.682852 18192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:40.683745 18192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:40.692878 18198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.692871 18197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.692873 18200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:40.693127 18192 server_base.cc:1034] running on GCE node
I20260923 14:40:40.693643 18192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:40.694203 18192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:40.695353 18192 hybrid_clock.cc:648] HybridClock initialized: now 1790174440695336 us; error 30 us; skew 500 ppm
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:40.697938 18192 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:40.698696 18192 webserver.cc:460] Webserver started at http://127.17.4.130:39357/ using document root <none> and password file <none>
I20260923 14:40:40.699239 18192 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:40.699325 18192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:40.699541 18192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:40.701445 18192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "d36718f66f0d4efab79dc085e941e041"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "eca9965debdfe3c4df76c93482ef7fcc"
server_key_iv: "26371205e74473b78ab6b066b6fb5637"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.701979 18192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "d36718f66f0d4efab79dc085e941e041"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "eca9965debdfe3c4df76c93482ef7fcc"
server_key_iv: "26371205e74473b78ab6b066b6fb5637"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.705412 18192 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:40:40.707544 18207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.708712 18192 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:40.708840 18192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "d36718f66f0d4efab79dc085e941e041"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "eca9965debdfe3c4df76c93482ef7fcc"
server_key_iv: "26371205e74473b78ab6b066b6fb5637"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.708938 18192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:40.725979 18192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:40.728629 18192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:40.728806 18192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:40.729331 18192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:40.730201 18192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:40.730266 18192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.730336 18192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:40.730382 18192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.738936 18192 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:38157
I20260923 14:40:40.738961 18320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:38157 every 8 connection(s)
I20260923 14:40:40.739732 18192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:40.746500 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18192
I20260923 14:40:40.746608 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:40.746883 17426 external_mini_cluster.cc:1428] Setting key c683bc77c1f5c9eef55ce31ea8c555e6
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:40.752681 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.741350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:57615 (local address 127.17.4.190:33395)
0923 14:40:40.741468 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:40.741472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:40.742249 (+ 777us) server_negotiation.cc:407] Connection header received
0923 14:40:40.743428 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:40.743430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:40.743471 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:40.743538 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:40.744539 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.745048 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.746096 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.746357 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.746463 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.749039 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:40.749045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:40.749051 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:40.749081 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:40.750531 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.751137 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.751143 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.751147 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.751223 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.751512 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.751517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.751522 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.751741 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:40.751864 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:40.752308 (+ 444us) server_negotiation.cc:299] Negotiation successful
0923 14:40:40.752442 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 14:40:40.753372 18323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.741688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:33395 (local address 127.17.4.130:57615)
0923 14:40:40.742103 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:40.742148 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:40.743234 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:40.743670 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:40.743676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:40.744010 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:40.744429 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:40.744440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.745149 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.745151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:40.746000 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:40.746008 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.746489 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.746492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:40.746664 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.747329 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:40.747345 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:40.748886 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:40.750637 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:40.750644 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:40.750675 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:40.751030 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:40.751302 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:40.751304 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:40.751305 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:40.751425 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:40.751854 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:40.751859 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:40.752072 (+ 213us) client_negotiation.cc:769] Sending connection context
0923 14:40:40.752223 (+ 151us) client_negotiation.cc:240] Negotiation successful
0923 14:40:40.752519 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":89,"threads_started":1}
I20260923 14:40:40.754431 18321 heartbeater.cc:347] Connected to a master server at 127.17.4.190:33395
I20260923 14:40:40.754655 18321 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:40.755080 18321 heartbeater.cc:511] Master 127.17.4.190:33395 requested a full tablet report, sending...
I20260923 14:40:40.756093 17996 ts_manager.cc:194] Registered new tserver with Master: d36718f66f0d4efab79dc085e941e041 (127.17.4.130:38157)
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:40:40.756654 17996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:57615
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:40.774415 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:33395
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:41057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:40.880535 18326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:40.880780 18326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:40.880851 18326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:40.885196 18326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:40.885275 18326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:40.885362 18326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:40.890588 18326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:33395
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:40.891505 18326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:40.892490 18326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:40:40.901398 18326 server_base.cc:1034] running on GCE node
W20260923 14:40:40.901404 18332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.901424 18331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:40.901443 18334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:40.902051 18326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:40.902581 18326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:40.903801 18326 hybrid_clock.cc:648] HybridClock initialized: now 1790174440903768 us; error 48 us; skew 500 ppm
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:40.912899 18326 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:40.913725 18326 webserver.cc:460] Webserver started at http://127.17.4.131:46493/ using document root <none> and password file <none>
I20260923 14:40:40.914230 18326 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:40.914286 18326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:40.914508 18326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:40.916460 18326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "a0027655c957493aab5b8740b89f0208"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "7a891c514258a5b4ef28390cdbb84679"
server_key_iv: "c5bb8eea394bc6ca9fec6233a5732862"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.916999 18326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "a0027655c957493aab5b8740b89f0208"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "7a891c514258a5b4ef28390cdbb84679"
server_key_iv: "c5bb8eea394bc6ca9fec6233a5732862"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.920526 18326 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:40.922672 18341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.923733 18326 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:40.923898 18326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "a0027655c957493aab5b8740b89f0208"
format_stamp: "Formatted at 2026-09-23 14:40:40 on dist-test-slave-54kg"
server_key: "7a891c514258a5b4ef28390cdbb84679"
server_key_iv: "c5bb8eea394bc6ca9fec6233a5732862"
server_key_version: "encryptionkey@0"
I20260923 14:40:40.923987 18326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:40.945237 18326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:40.947852 18326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:40.948025 18326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:40.948554 18326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:40.949308 18326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:40.949359 18326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.949424 18326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:40.949463 18326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:40.957973 18326 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:41031
I20260923 14:40:40.958004 18454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:41031 every 8 connection(s)
I20260923 14:40:40.958740 18326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:40.960083 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18326
I20260923 14:40:40.960165 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:40:40.960444 17426 external_mini_cluster.cc:1428] Setting key 50a3367b68728f9ec5021326f1926c53
Sep 23 14:40:40 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:40.971081 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.960420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:33409 (local address 127.17.4.190:33395)
0923 14:40:40.960566 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:40.960571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:40.961375 (+ 804us) server_negotiation.cc:407] Connection header received
0923 14:40:40.962566 (+ 1191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:40.962568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:40.962610 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:40.962674 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:40.963678 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.964233 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.965249 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.965458 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.965548 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.967958 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:40.967964 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:40.967971 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:40.967995 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:40.969164 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.969676 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.969681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.969683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.969762 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.970085 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.970090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.970092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.970255 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:40.970364 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:40.970809 (+ 445us) server_negotiation.cc:299] Negotiation successful
0923 14:40:40.970923 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:40:40.971879 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.960792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:33395 (local address 127.17.4.131:33409)
0923 14:40:40.961201 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:40.961256 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:40.962391 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:40.962799 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:40.962805 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:40.963126 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:40.963566 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:40.963578 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.964333 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.964336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:40.965153 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:40.965161 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.965605 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.965607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:40.965753 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.966297 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:40.966313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:40.967758 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:40.969277 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:40.969282 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:40.969312 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:40.969574 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:40.969863 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:40.969866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:40.969868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:40.969995 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:40.970354 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:40.970359 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:40.970600 (+ 241us) client_negotiation.cc:769] Sending connection context
0923 14:40:40.970771 (+ 171us) client_negotiation.cc:240] Negotiation successful
0923 14:40:40.971052 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":117,"threads_started":1}
I20260923 14:40:40.972939 18455 heartbeater.cc:347] Connected to a master server at 127.17.4.190:33395
I20260923 14:40:40.973165 18455 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:40.973701 18455 heartbeater.cc:511] Master 127.17.4.190:33395 requested a full tablet report, sending...
I20260923 14:40:40.974623 17996 ts_manager.cc:194] Registered new tserver with Master: a0027655c957493aab5b8740b89f0208 (127.17.4.131:41031)
I20260923 14:40:40.975155 17996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:33409
I20260923 14:40:40.985385 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:40:40.995398 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:40.988852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41164 (local address 127.17.4.190:33395)
0923 14:40:40.988963 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:40.988967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:40.989162 (+ 195us) server_negotiation.cc:407] Connection header received
0923 14:40:40.989304 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:40.989306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:40.989348 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:40.989414 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:40.990060 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.990608 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.991369 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:40.991568 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:40.991638 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:40.992926 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:40.992929 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:40.992931 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:40.992948 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:40.994109 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.994469 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.994471 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.994472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.994537 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:40.994747 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:40.994749 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:40.994750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:40.994942 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:40.995040 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:40.995209 (+ 169us) server_negotiation.cc:299] Negotiation successful
0923 14:40:40.995292 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:40:40.999620 17996 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:40:41.002571 17996 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:41.016117 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.009976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41031 (local address 127.0.0.1:60828)
0923 14:40:41.010699 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:41.010743 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:41.010865 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:41.011690 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:41.011698 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:41.011738 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:41.012075 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.012087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.013362 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.013365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.014661 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.014671 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.015526 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.015529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.015632 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.015686 (+ 54us) client_negotiation.cc:769] Sending connection context
0923 14:40:41.015848 (+ 162us) client_negotiation.cc:240] Negotiation successful
0923 14:40:41.015961 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":28,"spinlock_wait_cycles":6272,"thread_start_us":80,"threads_started":1}
I20260923 14:40:41.016307 18471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.010771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55526 (local address 127.17.4.130:38157)
0923 14:40:41.011245 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.011258 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.011276 (+ 18us) server_negotiation.cc:407] Connection header received
0923 14:40:41.011340 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.011344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.011552 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.011861 (+ 309us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:41.012021 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.013140 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.014824 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.015624 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.015803 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.015959 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.016050 (+ 91us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.016143 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":123,"threads_started":1}
I20260923 14:40:41.016711 18467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.010127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60828 (local address 127.17.4.131:41031)
0923 14:40:41.011190 (+ 1063us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.011202 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.011227 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:40:41.011306 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.011312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.011526 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.011739 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:41.012230 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.013204 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.014788 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.015403 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.015513 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.015648 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.016521 (+ 873us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.016603 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":158,"threads_started":1}
I20260923 14:40:41.016292 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.010238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:38157 (local address 127.0.0.1:55526)
0923 14:40:41.010831 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:41.010846 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:41.010941 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:41.011699 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:41.011702 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:41.011739 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:41.011919 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.011926 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.013283 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.013289 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.014683 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.014692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.015813 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.015817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.015909 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.015931 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:40:41.016020 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 14:40:41.016090 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":106,"spinlock_wait_cycles":4608,"thread_start_us":96,"threads_started":1}
I20260923 14:40:41.017150 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.010733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48354 (local address 127.17.4.129:40535)
0923 14:40:41.011129 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.011144 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.012140 (+ 996us) server_negotiation.cc:407] Connection header received
0923 14:40:41.012233 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.012238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.012433 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.012582 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:41.012835 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.013951 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.015355 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.016187 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.016282 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.016429 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.016693 (+ 264us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.016779 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":94,"threads_started":1}
I20260923 14:40:41.016855 18466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.010378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:40535 (local address 127.0.0.1:48354)
0923 14:40:41.012033 (+ 1655us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:41.012046 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:41.012135 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:41.012578 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:41.012581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:41.012600 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:41.012685 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.012691 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.014097 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.014100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.015225 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.015234 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.016494 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.016497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.016557 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.016572 (+ 15us) client_negotiation.cc:769] Sending connection context
0923 14:40:41.016663 (+ 91us) client_negotiation.cc:240] Negotiation successful
0923 14:40:41.016728 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1584,"thread_start_us":88,"threads_started":1}
I20260923 14:40:41.019575 18389 tablet_service.cc:1467] Processing CreateTablet for tablet 907921e2b10643b08576fa8b6db10227 (DEFAULT_TABLE table=test-table [id=11878b8b04024a3fa2bc56f0809538dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:41.019944 18255 tablet_service.cc:1467] Processing CreateTablet for tablet 907921e2b10643b08576fa8b6db10227 (DEFAULT_TABLE table=test-table [id=11878b8b04024a3fa2bc56f0809538dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:41.019943 18121 tablet_service.cc:1467] Processing CreateTablet for tablet 907921e2b10643b08576fa8b6db10227 (DEFAULT_TABLE table=test-table [id=11878b8b04024a3fa2bc56f0809538dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:41.020623 18389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907921e2b10643b08576fa8b6db10227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:41.020926 18255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907921e2b10643b08576fa8b6db10227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:41.020926 18121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907921e2b10643b08576fa8b6db10227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:41.026795 18472 tablet_bootstrap.cc:492] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: Bootstrap starting.
I20260923 14:40:41.028146 18474 tablet_bootstrap.cc:492] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: Bootstrap starting.
I20260923 14:40:41.029274 18472 tablet_bootstrap.cc:654] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:41.030198 18474 tablet_bootstrap.cc:654] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:41.030470 18472 log.cc:824] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:41.030972 18474 log.cc:824] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:41.031138 18473 tablet_bootstrap.cc:492] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: Bootstrap starting.
I20260923 14:40:41.032557 18472 tablet_bootstrap.cc:492] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: No bootstrap required, opened a new log
I20260923 14:40:41.032753 18472 ts_tablet_manager.cc:1397] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:40:41.032898 18474 tablet_bootstrap.cc:492] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: No bootstrap required, opened a new log
I20260923 14:40:41.033077 18474 ts_tablet_manager.cc:1397] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 14:40:41.033352 18473 tablet_bootstrap.cc:654] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:41.034274 18473 log.cc:824] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:41.036151 18473 tablet_bootstrap.cc:492] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: No bootstrap required, opened a new log
I20260923 14:40:41.036336 18473 ts_tablet_manager.cc:1397] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:40:41.036716 18472 raft_consensus.cc:348] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.036716 18474 raft_consensus.cc:348] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.036989 18474 raft_consensus.cc:374] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:41.036989 18472 raft_consensus.cc:374] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:41.037056 18472 raft_consensus.cc:729] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0027655c957493aab5b8740b89f0208, State: Initialized, Role: FOLLOWER
I20260923 14:40:41.037073 18474 raft_consensus.cc:729] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36718f66f0d4efab79dc085e941e041, State: Initialized, Role: FOLLOWER
I20260923 14:40:41.037544 18474 consensus_queue.cc:260] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.037544 18472 consensus_queue.cc:260] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.038547 18474 ts_tablet_manager.cc:1428] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260923 14:40:41.038547 18472 ts_tablet_manager.cc:1428] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 14:40:41.038888 18321 heartbeater.cc:503] Master 127.17.4.190:33395 was elected leader, sending a full tablet report...
I20260923 14:40:41.038904 18455 heartbeater.cc:503] Master 127.17.4.190:33395 was elected leader, sending a full tablet report...
I20260923 14:40:41.042855 18473 raft_consensus.cc:348] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.043078 18473 raft_consensus.cc:374] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:41.043140 18473 raft_consensus.cc:729] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748acf08da824f8782fd5986da00a142, State: Initialized, Role: FOLLOWER
I20260923 14:40:41.043597 18473 consensus_queue.cc:260] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.044263 18187 heartbeater.cc:503] Master 127.17.4.190:33395 was elected leader, sending a full tablet report...
I20260923 14:40:41.044577 18473 ts_tablet_manager.cc:1428] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260923 14:40:41.209609 18456 tablet.cc:2369] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:40:41.240825 18322 tablet.cc:2369] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:40:41.289481 18188 tablet.cc:2369] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:40:41.353551 18479 raft_consensus.cc:482] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:41.353818 18479 raft_consensus.cc:504] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.355090 18479 leader_election.cc:288] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d36718f66f0d4efab79dc085e941e041 (127.17.4.130:38157), 748acf08da824f8782fd5986da00a142 (127.17.4.129:40535)
I20260923 14:40:41.358909 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.355352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:38157 (local address 127.17.4.131:53583)
0923 14:40:41.355478 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:41.355495 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:41.355594 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:41.355937 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:41.355939 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:41.355976 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:41.356123 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.356130 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.356954 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.356957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.357777 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.357786 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.358460 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.358464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.358573 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.358605 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 14:40:41.358682 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 14:40:41.358736 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":2}
I20260923 14:40:41.358923 18471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.355443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:53583 (local address 127.17.4.130:38157)
0923 14:40:41.355571 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.355576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.355596 (+ 20us) server_negotiation.cc:407] Connection header received
0923 14:40:41.355745 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.355749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.355823 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.355905 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:41.356271 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.356847 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.357905 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.358344 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.358435 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.358474 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.358712 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.358800 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:40:41.358989 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.355353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:40535 (local address 127.17.4.131:45867)
0923 14:40:41.355893 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:41.355908 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:41.355999 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:41.356271 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:41.356274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:41.356289 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:41.356394 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.356400 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.357086 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.357088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.357920 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:41.357930 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.358570 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.358572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:41.358680 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.358705 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:40:41.358789 (+ 84us) client_negotiation.cc:240] Negotiation successful
0923 14:40:41.358849 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":150,"thread_start_us":124,"threads_started":1}
I20260923 14:40:41.359046 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.355458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:45867 (local address 127.17.4.129:40535)
0923 14:40:41.355573 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.355578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.355993 (+ 415us) server_negotiation.cc:407] Connection header received
0923 14:40:41.356115 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.356118 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.356172 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.356244 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:41.356496 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.356982 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.358041 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.358451 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.358562 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.358609 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.358835 (+ 226us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.358901 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 14:40:41.359608 18275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907921e2b10643b08576fa8b6db10227" candidate_uuid: "a0027655c957493aab5b8740b89f0208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36718f66f0d4efab79dc085e941e041" is_pre_election: true
I20260923 14:40:41.359620 18141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907921e2b10643b08576fa8b6db10227" candidate_uuid: "a0027655c957493aab5b8740b89f0208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748acf08da824f8782fd5986da00a142" is_pre_election: true
I20260923 14:40:41.359903 18141 raft_consensus.cc:2454] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0027655c957493aab5b8740b89f0208 in term 0.
I20260923 14:40:41.359923 18275 raft_consensus.cc:2454] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0027655c957493aab5b8740b89f0208 in term 0.
I20260923 14:40:41.360383 18342 leader_election.cc:302] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748acf08da824f8782fd5986da00a142, a0027655c957493aab5b8740b89f0208; no voters:
I20260923 14:40:41.360648 18479 raft_consensus.cc:2781] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:41.360728 18479 raft_consensus.cc:482] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:41.360770 18479 raft_consensus.cc:3037] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:41.361745 18479 raft_consensus.cc:504] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.362035 18479 leader_election.cc:288] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [CANDIDATE]: Term 1 election: Requested vote from peers d36718f66f0d4efab79dc085e941e041 (127.17.4.130:38157), 748acf08da824f8782fd5986da00a142 (127.17.4.129:40535)
I20260923 14:40:41.362366 18275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907921e2b10643b08576fa8b6db10227" candidate_uuid: "a0027655c957493aab5b8740b89f0208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d36718f66f0d4efab79dc085e941e041"
I20260923 14:40:41.362402 18141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907921e2b10643b08576fa8b6db10227" candidate_uuid: "a0027655c957493aab5b8740b89f0208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748acf08da824f8782fd5986da00a142"
I20260923 14:40:41.362493 18275 raft_consensus.cc:3037] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:41.362507 18141 raft_consensus.cc:3037] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:41.363469 18141 raft_consensus.cc:2454] T 907921e2b10643b08576fa8b6db10227 P 748acf08da824f8782fd5986da00a142 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0027655c957493aab5b8740b89f0208 in term 1.
I20260923 14:40:41.363610 18275 raft_consensus.cc:2454] T 907921e2b10643b08576fa8b6db10227 P d36718f66f0d4efab79dc085e941e041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0027655c957493aab5b8740b89f0208 in term 1.
I20260923 14:40:41.363744 18342 leader_election.cc:302] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748acf08da824f8782fd5986da00a142, a0027655c957493aab5b8740b89f0208; no voters:
I20260923 14:40:41.363907 18479 raft_consensus.cc:2781] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:41.364140 18479 raft_consensus.cc:686] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [term 1 LEADER]: Becoming Leader. State: Replica: a0027655c957493aab5b8740b89f0208, State: Running, Role: LEADER
I20260923 14:40:41.364456 18479 consensus_queue.cc:237] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } }
I20260923 14:40:41.367581 17996 catalog_manager.cc:5495] T 907921e2b10643b08576fa8b6db10227 P a0027655c957493aab5b8740b89f0208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0027655c957493aab5b8740b89f0208 (127.17.4.131). New cstate: current_term: 1 leader_uuid: "a0027655c957493aab5b8740b89f0208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0027655c957493aab5b8740b89f0208" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d36718f66f0d4efab79dc085e941e041" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 38157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "748acf08da824f8782fd5986da00a142" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40535 } health_report { overall_health: UNKNOWN } } }
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:41.466343 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.457592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48366 (local address 127.17.4.129:40535)
0923 14:40:41.457771 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.457776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.457974 (+ 198us) server_negotiation.cc:407] Connection header received
0923 14:40:41.458081 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.458083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.458125 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.458192 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:41.458853 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.459351 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.460140 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.460359 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.460433 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.462845 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:41.462855 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:41.462871 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:41.462893 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:41.464792 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:41.465171 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:41.465176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:41.465177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:41.465263 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:41.465482 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:41.465485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:41.465486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:41.465739 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:41.465890 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.466026 (+ 136us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.466115 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:41.492342 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.484424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48382 (local address 127.17.4.129:40535)
0923 14:40:41.484550 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.484553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.484681 (+ 128us) server_negotiation.cc:407] Connection header received
0923 14:40:41.484767 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.484769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.484803 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.484866 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:41.485426 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.485903 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.486751 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.486948 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.487023 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.489490 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:41.489493 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:41.489495 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:41.489514 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:41.490823 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:41.491166 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:41.491168 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:41.491169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:41.491237 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:41.491464 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:41.491467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:41.491468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:41.491638 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:41.491823 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.492040 (+ 217us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.492145 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[17951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[17951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:41.515106 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:41.507666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48390 (local address 127.17.4.129:40535)
0923 14:40:41.507867 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:41.507876 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:41.507940 (+ 64us) server_negotiation.cc:407] Connection header received
0923 14:40:41.508035 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:41.508037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:41.508071 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:41.508132 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:41.508699 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.509138 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.509926 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:41.510133 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:41.510204 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:41.512453 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:41.512457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:41.512459 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:41.512482 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:41.513706 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:41.514091 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:41.514093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:41.514095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:41.514161 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:41.514376 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:41.514378 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:41.514379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:41.514530 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:41.514631 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:41.514822 (+ 191us) server_negotiation.cc:299] Negotiation successful
0923 14:40:41.514902 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
W20260923 14:40:41.516390 18101 tablet_service.cc:2908] Rejecting scan request for tablet 907921e2b10643b08576fa8b6db10227: Uninitialized: clean time has not yet been initialized
I20260923 14:40:41.518175 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18058
I20260923 14:40:41.523624 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18192
I20260923 14:40:41.529760 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18326
I20260923 14:40:41.534886 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 17964
2026-09-23T14:40:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2584 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[18496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[18496](info): set up 2 sockets
Sep 23 14:40:41 dist-test-slave-54kg krb5kdc[18496](info): commencing operation
krb5kdc: starting...
W20260923 14:40:42.552515 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.996s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:42 dist-test-slave-54kg krb5kdc[18496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:42.680948 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36777
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:36777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:42.785935 18509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:42.786157 18509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:42.786195 18509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:42.790045 18509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:42.790086 18509 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 14:40:42.790103 18509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:42.790120 18509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:42.790135 18509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:42.790150 18509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:42.794996 18509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:36777
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:42.795981 18509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:42.796882 18509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:42.804936 18517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:42.804942 18515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:42.804999 18509 server_base.cc:1034] running on GCE node
W20260923 14:40:42.804942 18514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:42.805809 18509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:42.806753 18509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:42.807901 18509 hybrid_clock.cc:648] HybridClock initialized: now 1790174442807875 us; error 37 us; skew 500 ppm
Sep 23 14:40:42 dist-test-slave-54kg krb5kdc[18496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174442, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:42.810424 18509 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:42.811251 18509 webserver.cc:460] Webserver started at http://127.17.4.190:45625/ using document root <none> and password file <none>
I20260923 14:40:42.811722 18509 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:42.811860 18509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:42.812040 18509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:42.813918 18509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b"
format_stamp: "Formatted at 2026-09-23 14:40:42 on dist-test-slave-54kg"
server_key: "139ec77a8c6ad2a52025b19bc9a5d0be"
server_key_iv: "4f733ecb2fa55fd9ed080310d9a88af9"
server_key_version: "encryptionkey@0"
I20260923 14:40:42.814390 18509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b"
format_stamp: "Formatted at 2026-09-23 14:40:42 on dist-test-slave-54kg"
server_key: "139ec77a8c6ad2a52025b19bc9a5d0be"
server_key_iv: "4f733ecb2fa55fd9ed080310d9a88af9"
server_key_version: "encryptionkey@0"
I20260923 14:40:42.818002 18509 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260923 14:40:42.820318 18524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:42.821529 18509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:40:42.821657 18509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b"
format_stamp: "Formatted at 2026-09-23 14:40:42 on dist-test-slave-54kg"
server_key: "139ec77a8c6ad2a52025b19bc9a5d0be"
server_key_iv: "4f733ecb2fa55fd9ed080310d9a88af9"
server_key_version: "encryptionkey@0"
I20260923 14:40:42.821761 18509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:42.838778 18509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:42.842231 18509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:42.842442 18509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:42.850859 18509 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:36777
I20260923 14:40:42.850888 18586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:36777 every 8 connection(s)
I20260923 14:40:42.851799 18509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:42.854403 18587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:42.856462 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18509
I20260923 14:40:42.856560 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:42.856835 17426 external_mini_cluster.cc:1428] Setting key 39b4ed50a640f88f0a0f9bb1e38ffa94
I20260923 14:40:42.860146 18587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: Bootstrap starting.
I20260923 14:40:42.862126 18587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:42.862835 18587 log.cc:824] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:42.864591 18587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: No bootstrap required, opened a new log
Sep 23 14:40:42 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:42.867630 18587 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36777 } }
I20260923 14:40:42.867918 18587 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:42.867997 18587 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd5da8fd9ff14537b4fe0a2bd88a467b, State: Initialized, Role: FOLLOWER
I20260923 14:40:42.868464 18587 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36777 } }
I20260923 14:40:42.868609 18587 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:42.868670 18587 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:42.868767 18587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:42.869735 18587 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36777 } }
I20260923 14:40:42.870054 18587 leader_election.cc:302] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd5da8fd9ff14537b4fe0a2bd88a467b; no voters:
I20260923 14:40:42.870323 18587 leader_election.cc:288] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:42.870424 18592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:42.870566 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:42.858222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.17.4.190:36777)
0923 14:40:42.858619 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:42.858633 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:42.858666 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:40:42.859290 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:42.859307 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:42.859604 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:42.859985 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:42.860728 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:42.861657 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:42.862566 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:42.863073 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:42.863242 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:42.865638 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:42.865643 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:42.865655 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:42.865680 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:42.867295 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:42.867791 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:42.867807 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:42.867814 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:42.867955 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:42.868295 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:42.868298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:42.868300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:42.868789 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:42.869002 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:42.869406 (+ 404us) server_negotiation.cc:299] Negotiation successful
0923 14:40:42.869706 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":117,"threads_started":1}
I20260923 14:40:42.870669 18592 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [term 1 LEADER]: Becoming Leader. State: Replica: bd5da8fd9ff14537b4fe0a2bd88a467b, State: Running, Role: LEADER
I20260923 14:40:42.870951 18592 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36777 } }
I20260923 14:40:42.871534 18587 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:42.871920 18592 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36777 } } }
I20260923 14:40:42.872030 18592 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:42.872217 18592 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd5da8fd9ff14537b4fe0a2bd88a467b. Latest consensus state: current_term: 1 leader_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5da8fd9ff14537b4fe0a2bd88a467b" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36777 } } }
I20260923 14:40:42.872296 18592 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:42.873030 18596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:42.876051 18596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:42.881312 18596 catalog_manager.cc:1347] Generated new cluster ID: 767f847c2ee7450abf04eef8d184ec02
I20260923 14:40:42.881399 18596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:42.907392 18596 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:42.908394 18596 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:42.916612 18596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: Generated new TSK 0
I20260923 14:40:42.917251 18596 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:42.946883 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36777
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:43.053912 18613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:43.054131 18613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:43.054169 18613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:43.057894 18613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:43.057940 18613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:43.057976 18613 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:40:43.058007 18613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:43.062880 18613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:36777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:43.063712 18613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:43.064644 18613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:43.073809 18621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:43.073843 18618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:43.073855 18619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:43.074028 18613 server_base.cc:1034] running on GCE node
I20260923 14:40:43.074424 18613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:43.074985 18613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:43.076131 18613 hybrid_clock.cc:648] HybridClock initialized: now 1790174443076114 us; error 27 us; skew 500 ppm
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:43.078692 18613 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:43.079388 18613 webserver.cc:460] Webserver started at http://127.17.4.129:34821/ using document root <none> and password file <none>
I20260923 14:40:43.079931 18613 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:43.079989 18613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:43.080130 18613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:43.081962 18613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "85f1b42c4afe41bba0dfbb537d6e33c1"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "d59e49ca2a5ca96702beda1b5f7ec725"
server_key_iv: "4d3f6b7e7e44805ceda8a759364b93b5"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.082445 18613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "85f1b42c4afe41bba0dfbb537d6e33c1"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "d59e49ca2a5ca96702beda1b5f7ec725"
server_key_iv: "4d3f6b7e7e44805ceda8a759364b93b5"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.085660 18613 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:40:43.087859 18628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:43.088899 18613 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:43.089004 18613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "85f1b42c4afe41bba0dfbb537d6e33c1"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "d59e49ca2a5ca96702beda1b5f7ec725"
server_key_iv: "4d3f6b7e7e44805ceda8a759364b93b5"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.089098 18613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:43.102804 18613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:43.105777 18613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:43.105929 18613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:43.107234 18613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:43.107300 18613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:43.107354 18613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:43.107405 18613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:43.118181 18613 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:44321
I20260923 14:40:43.118235 18743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:44321 every 8 connection(s)
I20260923 14:40:43.118978 18613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:40:43.120560 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.107995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55427 (local address 127.17.4.190:36777)
0923 14:40:43.108114 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.108117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.109026 (+ 909us) server_negotiation.cc:407] Connection header received
0923 14:40:43.109959 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.109964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.110027 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.110142 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.111447 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.112160 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.113805 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.114188 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.114302 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.117053 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.117057 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.117060 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.117086 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.118638 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.119148 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.119151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.119153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.119234 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.119592 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.119595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.119597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.119822 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.119928 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.120348 (+ 420us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.120448 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:40:43.121296 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.108473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.17.4.129:55427)
0923 14:40:43.108891 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.108928 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.109715 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.110337 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.110347 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.110756 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.111299 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.111318 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.112303 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.112309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.113656 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.113667 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.114376 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.114381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.114590 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.115172 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.115190 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.116898 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.118753 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.118758 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.118770 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.119023 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.119321 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.119327 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.119332 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.119481 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.119961 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.119969 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.120160 (+ 191us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.120303 (+ 143us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.120513 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":114,"threads_started":1}
I20260923 14:40:43.122360 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18613
I20260923 14:40:43.122480 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:43.122660 18744 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36777
I20260923 14:40:43.122785 17426 external_mini_cluster.cc:1428] Setting key ffb463e00076834d2894f0317554ed0f
I20260923 14:40:43.122792 18744 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:43.123307 18744 heartbeater.cc:511] Master 127.17.4.190:36777 requested a full tablet report, sending...
I20260923 14:40:43.124893 18540 ts_manager.cc:194] Registered new tserver with Master: 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321)
I20260923 14:40:43.126332 18540 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:55427
I20260923 14:40:43.132898 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.124628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:58569 (local address 127.17.4.190:36777)
0923 14:40:43.124750 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.124754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.124964 (+ 210us) server_negotiation.cc:407] Connection header received
0923 14:40:43.125058 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.125061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.125101 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.125189 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.125587 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.127601 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.128408 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.128631 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.128734 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.129954 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.129957 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.129959 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.129978 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.131280 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.131750 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.131753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.131754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.131886 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.132169 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.132171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.132172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.132333 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.132413 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.132708 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.132788 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:40:43.133016 18750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.124654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.17.4.129:58569)
0923 14:40:43.124885 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.124894 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.124991 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.125275 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.125277 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.125414 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.125488 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.125492 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.127716 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.127719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.128294 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.128302 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.128737 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.128740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.128838 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.129289 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.129308 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.129779 (+ 471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.131383 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.131387 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.131390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.131651 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.131981 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.131986 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.131990 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.132081 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.132439 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.132442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.132544 (+ 102us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.132673 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.132829 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:43.150835 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36777
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:43.252614 18753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:43.252885 18753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:43.252964 18753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:43.256769 18753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:43.256852 18753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:43.256919 18753 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:40:43.257014 18753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:43.262010 18753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:36777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:43.262970 18753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:43.263942 18753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:43.272907 18758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:43.272922 18759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:43.272899 18761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:43.273185 18753 server_base.cc:1034] running on GCE node
I20260923 14:40:43.273604 18753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:43.274163 18753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:43.275350 18753 hybrid_clock.cc:648] HybridClock initialized: now 1790174443275333 us; error 29 us; skew 500 ppm
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:43.278043 18753 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:43.278817 18753 webserver.cc:460] Webserver started at http://127.17.4.130:42793/ using document root <none> and password file <none>
I20260923 14:40:43.279343 18753 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:43.279425 18753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:43.279628 18753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:43.281448 18753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "c07dd85f8ead48a88267cdda07e6f86e"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "ec7df4a0fe460f3bf668773d777f7daa"
server_key_iv: "a5dd58acc92df08b3e59fffd46ab1913"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.281960 18753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "c07dd85f8ead48a88267cdda07e6f86e"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "ec7df4a0fe460f3bf668773d777f7daa"
server_key_iv: "a5dd58acc92df08b3e59fffd46ab1913"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.285437 18753 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:40:43.287671 18768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:43.288780 18753 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:43.288908 18753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "c07dd85f8ead48a88267cdda07e6f86e"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "ec7df4a0fe460f3bf668773d777f7daa"
server_key_iv: "a5dd58acc92df08b3e59fffd46ab1913"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.289011 18753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:43.306684 18753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:43.309187 18753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:43.309391 18753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:43.310680 18753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:43.310755 18753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:43.310822 18753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:43.310880 18753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:43.321728 18753 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:34145
I20260923 14:40:43.321846 18883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:34145 every 8 connection(s)
I20260923 14:40:43.322849 18753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:43.324954 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.311499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:33911 (local address 127.17.4.190:36777)
0923 14:40:43.311617 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.311620 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.312589 (+ 969us) server_negotiation.cc:407] Connection header received
0923 14:40:43.313612 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.313616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.313681 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.313741 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.315498 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.316262 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.318172 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.318486 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.318606 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.321281 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.321285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.321288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.321315 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.322947 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.323492 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.323498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.323500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.323590 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.324019 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.324023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.324024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.324198 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.324278 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.324752 (+ 474us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.324840 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:40:43.325652 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.311995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.17.4.130:33911)
0923 14:40:43.312440 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.312478 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.313357 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.314180 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.314188 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.314684 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.315337 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.315371 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.316427 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.316445 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.318013 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.318026 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.318649 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.318653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.318857 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.319386 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.319407 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.321118 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.323087 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.323093 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.323110 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.323381 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.323699 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.323701 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.323703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.323906 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.324292 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.324296 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.324504 (+ 208us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.324699 (+ 195us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.324937 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":125,"threads_started":1}
I20260923 14:40:43.326095 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18753
I20260923 14:40:43.326244 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:43.326552 17426 external_mini_cluster.cc:1428] Setting key c657de8ad46c2511dc425d175d555780
I20260923 14:40:43.327291 18884 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36777
I20260923 14:40:43.327469 18884 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:43.328182 18884 heartbeater.cc:511] Master 127.17.4.190:36777 requested a full tablet report, sending...
I20260923 14:40:43.329149 18541 ts_manager.cc:194] Registered new tserver with Master: c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130:34145)
I20260923 14:40:43.329679 18541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:33911
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:40:43.337179 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.329832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:37355 (local address 127.17.4.190:36777)
0923 14:40:43.329952 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.329957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.329971 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:40:43.330009 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.330013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.330058 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.330132 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.330738 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.331508 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.332869 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.333064 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.333141 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.334330 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.334333 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.334335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.334353 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.335715 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.336203 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.336205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.336206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.336271 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.336562 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.336564 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.336565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.336730 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.336806 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.337012 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.337085 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:40:43.337191 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.328750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.17.4.130:37355)
0923 14:40:43.329022 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.329037 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.329117 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.330242 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.330246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.330472 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.330595 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.330605 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.331681 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.331687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.332754 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.332764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.333184 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.333192 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.333337 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.333741 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.333759 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.334193 (+ 434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.335875 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.335881 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.335885 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.336116 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.336361 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.336367 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.336370 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.336467 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.336824 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.336826 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.336894 (+ 68us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.336979 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.337069 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":113,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:43.355011 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36777
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:43.460021 18893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:43.460297 18893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:43.460392 18893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:43.464337 18893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:43.464418 18893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:43.464488 18893 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:40:43.464568 18893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:43.469554 18893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:36777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:43.470517 18893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:43.471515 18893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:43.480845 18901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:43.480851 18898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:43.480885 18899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:43.481402 18893 server_base.cc:1034] running on GCE node
I20260923 14:40:43.481763 18893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:43.482451 18893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:43.483629 18893 hybrid_clock.cc:648] HybridClock initialized: now 1790174443483603 us; error 38 us; skew 500 ppm
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:43.486138 18893 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:43.487018 18893 webserver.cc:460] Webserver started at http://127.17.4.131:32951/ using document root <none> and password file <none>
I20260923 14:40:43.487516 18893 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:43.487596 18893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:43.487852 18893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:43.489689 18893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "c8da0aa7efab4e7e9496888fec7a0f9e"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "270fee218272b8cbb1504629ca0b8246"
server_key_iv: "5a29cae7ad8901bb98c428453754b15a"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.490226 18893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "c8da0aa7efab4e7e9496888fec7a0f9e"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "270fee218272b8cbb1504629ca0b8246"
server_key_iv: "5a29cae7ad8901bb98c428453754b15a"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.493844 18893 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 14:40:43.496012 18908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:43.497123 18893 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:43.497254 18893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "c8da0aa7efab4e7e9496888fec7a0f9e"
format_stamp: "Formatted at 2026-09-23 14:40:43 on dist-test-slave-54kg"
server_key: "270fee218272b8cbb1504629ca0b8246"
server_key_iv: "5a29cae7ad8901bb98c428453754b15a"
server_key_version: "encryptionkey@0"
I20260923 14:40:43.497355 18893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:43.509933 18893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:43.512482 18893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:43.512665 18893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:43.514014 18893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:43.514082 18893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:43.514142 18893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:43.514178 18893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:43.524889 18893 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:33533
I20260923 14:40:43.525700 18893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:43.526477 19023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:33533 every 8 connection(s)
I20260923 14:40:43.527535 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.514668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:35679 (local address 127.17.4.190:36777)
0923 14:40:43.514830 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.514836 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.515999 (+ 1163us) server_negotiation.cc:407] Connection header received
0923 14:40:43.517032 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.517035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.517090 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.517191 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.518481 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.519114 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.520445 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.520728 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.520866 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.523809 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.523813 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.523815 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.523842 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.525365 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.525895 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.525900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.525907 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.526021 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.526364 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.526368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.526371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.526629 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.526720 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.527329 (+ 609us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.527422 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 14:40:43.528275 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.515416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.17.4.131:35679)
0923 14:40:43.515848 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.515893 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.516837 (+ 944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.517348 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.517373 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.517778 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.518335 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.518359 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.519234 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.519239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.520305 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.520322 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.520909 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.520913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.521103 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.521670 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.521697 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.523634 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.525483 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.525488 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.525502 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.525754 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.526098 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.526102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.526104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.526260 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.526792 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.526823 (+ 31us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.527105 (+ 282us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.527242 (+ 137us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.527473 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":115,"threads_started":1}
I20260923 14:40:43.529395 19024 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36777
I20260923 14:40:43.529577 19024 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:43.530025 19024 heartbeater.cc:511] Master 127.17.4.190:36777 requested a full tablet report, sending...
I20260923 14:40:43.530134 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 18893
I20260923 14:40:43.530256 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:40:43.530524 17426 external_mini_cluster.cc:1428] Setting key 0d25c40ba85892e19b7a6c03e021a86c
I20260923 14:40:43.531054 18540 ts_manager.cc:194] Registered new tserver with Master: c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533)
I20260923 14:40:43.531663 18540 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:35679
I20260923 14:40:43.532466 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:40:43.539258 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.531656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:33771 (local address 127.17.4.190:36777)
0923 14:40:43.531754 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.531758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.532432 (+ 674us) server_negotiation.cc:407] Connection header received
0923 14:40:43.532549 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.532553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.532597 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.532678 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.533173 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.533816 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.534778 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.534989 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.535094 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.536115 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.536118 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.536121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.536148 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.537576 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.538002 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.538009 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.538013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.538100 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.538354 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.538360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.538365 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.538596 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.538700 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.539017 (+ 317us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.539115 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 14:40:43.539268 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.531588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.17.4.131:33771)
0923 14:40:43.532340 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.532355 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.532455 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.532709 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.532712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.532922 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.533048 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.533055 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.533959 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.533965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.534660 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.534668 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.535097 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.535100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.535185 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.535636 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.535647 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.535994 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.537696 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.537698 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.537700 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.537906 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.538192 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.538194 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.538196 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.538266 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.538751 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.538754 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.538842 (+ 88us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.538965 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.539089 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":87,"threads_started":1}
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:43.557880 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.550218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41722 (local address 127.17.4.190:36777)
0923 14:40:43.550364 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.550383 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.550392 (+ 9us) server_negotiation.cc:407] Connection header received
0923 14:40:43.550419 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.550422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.550452 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.550536 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.551276 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.551806 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.552655 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.552869 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.552978 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.555114 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.555119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.555126 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.555146 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.556287 (+ 1141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.556708 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.556716 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.556717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.556783 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.557042 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.557046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.557048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.557202 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.557344 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.557564 (+ 220us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.557722 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:40:43.560427 18541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:40:43.563268 18541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:43.576411 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.570966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:33533 (local address 127.0.0.1:37736)
0923 14:40:43.571332 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.571381 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.571506 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.572466 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.572472 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.572497 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.572621 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.572628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.573957 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.573960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.575065 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.575074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.575913 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.575917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.576018 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.576054 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.576170 (+ 116us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.576281 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":69,"threads_started":1}
I20260923 14:40:43.576422 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.571093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37736 (local address 127.17.4.131:33533)
0923 14:40:43.571887 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.571899 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.571921 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:40:43.572014 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.572022 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.572230 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.572482 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.572754 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.573776 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.575196 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.575698 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.575913 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.576077 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.576197 (+ 120us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.576281 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":111,"threads_started":1}
I20260923 14:40:43.577375 19044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.571668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34145 (local address 127.0.0.1:59152)
0923 14:40:43.572507 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.572520 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.572602 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.573246 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.573249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.573264 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.573378 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.573385 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.574782 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.574785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.575917 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.575924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.576990 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.576994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.577090 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.577112 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.577190 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.577252 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260923 14:40:43.577469 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.571899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59152 (local address 127.17.4.130:34145)
0923 14:40:43.572339 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.572353 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.572624 (+ 271us) server_negotiation.cc:407] Connection header received
0923 14:40:43.572709 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.572775 (+ 66us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.572974 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.573120 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.573503 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.574668 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.576029 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.576829 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.576981 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.577129 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.577214 (+ 85us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.577301 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":117,"threads_started":1}
I20260923 14:40:43.579420 18958 tablet_service.cc:1467] Processing CreateTablet for tablet e6b79dc8c73144519ebdde968bd8fc8f (DEFAULT_TABLE table=test-table [id=5c2a6dccc7fa4b5cbb35ea51b4098c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:43.579931 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.571386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:44321 (local address 127.0.0.1:44496)
0923 14:40:43.572234 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.572247 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.572348 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.573059 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.573095 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.573110 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.573218 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.573224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.574583 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.574586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.575805 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.575815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.577206 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.577209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.577297 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.577318 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.577389 (+ 71us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.577449 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"thread_start_us":91,"threads_started":1}
I20260923 14:40:43.580096 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.571827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44496 (local address 127.17.4.129:44321)
0923 14:40:43.572583 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.572594 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.572615 (+ 21us) server_negotiation.cc:407] Connection header received
0923 14:40:43.572769 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.572776 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.572925 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.573070 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.573327 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.574457 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.576071 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.576887 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.576988 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.577129 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.579877 (+ 2748us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.579969 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":101,"threads_started":1}
I20260923 14:40:43.579826 18818 tablet_service.cc:1467] Processing CreateTablet for tablet e6b79dc8c73144519ebdde968bd8fc8f (DEFAULT_TABLE table=test-table [id=5c2a6dccc7fa4b5cbb35ea51b4098c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:43.580489 18958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b79dc8c73144519ebdde968bd8fc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.580842 18818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b79dc8c73144519ebdde968bd8fc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.582522 18678 tablet_service.cc:1467] Processing CreateTablet for tablet e6b79dc8c73144519ebdde968bd8fc8f (DEFAULT_TABLE table=test-table [id=5c2a6dccc7fa4b5cbb35ea51b4098c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:43.583434 18678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b79dc8c73144519ebdde968bd8fc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.587265 19047 tablet_bootstrap.cc:492] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Bootstrap starting.
I20260923 14:40:43.588565 19048 tablet_bootstrap.cc:492] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Bootstrap starting.
I20260923 14:40:43.589674 19047 tablet_bootstrap.cc:654] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.590533 19048 tablet_bootstrap.cc:654] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.590546 19047 log.cc:824] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:43.591187 19049 tablet_bootstrap.cc:492] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Bootstrap starting.
I20260923 14:40:43.591320 19048 log.cc:824] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:43.592537 19047 tablet_bootstrap.cc:492] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: No bootstrap required, opened a new log
I20260923 14:40:43.592741 19047 ts_tablet_manager.cc:1397] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:40:43.593228 19048 tablet_bootstrap.cc:492] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: No bootstrap required, opened a new log
I20260923 14:40:43.593403 19048 ts_tablet_manager.cc:1397] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:40:43.593909 19049 tablet_bootstrap.cc:654] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.594713 19049 log.cc:824] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:43.596156 19047 raft_consensus.cc:348] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.596375 19047 raft_consensus.cc:374] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.596426 19047 raft_consensus.cc:729] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8da0aa7efab4e7e9496888fec7a0f9e, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.596590 19049 tablet_bootstrap.cc:492] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: No bootstrap required, opened a new log
I20260923 14:40:43.596767 19049 ts_tablet_manager.cc:1397] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:40:43.596891 19047 consensus_queue.cc:260] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.597131 19048 raft_consensus.cc:348] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.597393 19048 raft_consensus.cc:374] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.597452 19048 raft_consensus.cc:729] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07dd85f8ead48a88267cdda07e6f86e, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.597589 19024 heartbeater.cc:503] Master 127.17.4.190:36777 was elected leader, sending a full tablet report...
I20260923 14:40:43.597904 19047 ts_tablet_manager.cc:1428] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:40:43.597920 19048 consensus_queue.cc:260] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.598542 18884 heartbeater.cc:503] Master 127.17.4.190:36777 was elected leader, sending a full tablet report...
I20260923 14:40:43.599720 19048 ts_tablet_manager.cc:1428] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 14:40:43.600766 19049 raft_consensus.cc:348] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.601032 19049 raft_consensus.cc:374] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.601089 19049 raft_consensus.cc:729] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f1b42c4afe41bba0dfbb537d6e33c1, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.601459 19049 consensus_queue.cc:260] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.602088 18744 heartbeater.cc:503] Master 127.17.4.190:36777 was elected leader, sending a full tablet report...
I20260923 14:40:43.602322 19049 ts_tablet_manager.cc:1428] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:40:43.607963 19054 raft_consensus.cc:482] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:43.608075 19054 raft_consensus.cc:504] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.608876 19054 leader_election.cc:288] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533), 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321)
I20260923 14:40:43.613078 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.609342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41663 (local address 127.17.4.129:44321)
0923 14:40:43.609446 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.609450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.609464 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:40:43.609512 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.609517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.609564 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.609637 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.609923 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.610727 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.611997 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.612595 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.612678 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.612722 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.612944 (+ 222us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.612995 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 14:40:43.613112 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.609093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:44321 (local address 127.17.4.130:41663)
0923 14:40:43.609346 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.609362 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.609444 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.609658 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.609660 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.609676 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.609815 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.609822 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.610841 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.610844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.611888 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.611897 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.612695 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.612699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.612824 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.612849 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.612927 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.612993 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260923 14:40:43.613656 18698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b79dc8c73144519ebdde968bd8fc8f" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" is_pre_election: true
I20260923 14:40:43.613804 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.609093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:33533 (local address 127.17.4.130:49879)
0923 14:40:43.609478 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.609492 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.609571 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.609809 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.609811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.609824 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.610492 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.610502 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.611429 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.611432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.612436 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.612446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.613375 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.613378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.613493 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.613516 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.613594 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.613658 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":56,"thread_start_us":108,"threads_started":1}
I20260923 14:40:43.613919 18698 raft_consensus.cc:2454] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 0.
I20260923 14:40:43.613951 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.609281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:49879 (local address 127.17.4.131:33533)
0923 14:40:43.609562 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.609565 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.609575 (+ 10us) server_negotiation.cc:407] Connection header received
0923 14:40:43.609672 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.609675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.609714 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.609790 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.610614 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.611323 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.612548 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.613124 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.613239 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.613310 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.613704 (+ 394us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.613821 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260923 14:40:43.614394 18769 leader_election.cc:302] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f1b42c4afe41bba0dfbb537d6e33c1, c07dd85f8ead48a88267cdda07e6f86e; no voters:
I20260923 14:40:43.614449 18978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b79dc8c73144519ebdde968bd8fc8f" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" is_pre_election: true
I20260923 14:40:43.614665 19054 raft_consensus.cc:2781] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:43.614660 18978 raft_consensus.cc:2454] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 0.
I20260923 14:40:43.614754 19054 raft_consensus.cc:482] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:43.614813 19054 raft_consensus.cc:3037] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.615851 19054 raft_consensus.cc:504] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
I20260923 14:40:43.616161 19054 leader_election.cc:288] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 election: Requested vote from peers c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533), 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321)
I20260923 14:40:43.616483 18698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b79dc8c73144519ebdde968bd8fc8f" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1"
I20260923 14:40:43.616483 18978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b79dc8c73144519ebdde968bd8fc8f" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e"
I20260923 14:40:43.616595 18698 raft_consensus.cc:3037] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.616595 18978 raft_consensus.cc:3037] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.617837 18978 raft_consensus.cc:2454] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 1.
I20260923 14:40:43.617832 18698 raft_consensus.cc:2454] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 1.
I20260923 14:40:43.618095 18769 leader_election.cc:302] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f1b42c4afe41bba0dfbb537d6e33c1, c07dd85f8ead48a88267cdda07e6f86e; no voters:
I20260923 14:40:43.618284 19054 raft_consensus.cc:2781] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:43.618456 19054 raft_consensus.cc:686] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 1 LEADER]: Becoming Leader. State: Replica: c07dd85f8ead48a88267cdda07e6f86e, State: Running, Role: LEADER
I20260923 14:40:43.618752 19054 consensus_queue.cc:237] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } }
W20260923 14:40:43.620348 18745 tablet.cc:2369] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:40:43.621508 18540 catalog_manager.cc:5495] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e reported cstate change: term changed from 0 to 1, leader changed from <none> to c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130). New cstate: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } health_report { overall_health: UNKNOWN } } }
I20260923 14:40:43.641661 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.637884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59160 (local address 127.17.4.130:34145)
0923 14:40:43.637997 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.638000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.638087 (+ 87us) server_negotiation.cc:407] Connection header received
0923 14:40:43.638242 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.638244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.638288 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.638367 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:43.638590 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.639438 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.640334 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.640555 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.640665 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.640963 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.641304 (+ 341us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.641421 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.641497 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.641545 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:40:43.647995 18698 raft_consensus.cc:1261] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Refusing update from remote peer c07dd85f8ead48a88267cdda07e6f86e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:43.648280 18978 raft_consensus.cc:1261] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Refusing update from remote peer c07dd85f8ead48a88267cdda07e6f86e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:43.648663 19054 consensus_queue.cc:1035] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:43.648860 19057 consensus_queue.cc:1035] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:43.657397 19061 mvcc.cc:205] Tried to move back new op lower bound from 7332554521175478272 to 7332554521064685568. Current Snapshot: MvccSnapshot[applied={T|T < 7332554521175478272}]
I20260923 14:40:43.657935 19062 mvcc.cc:205] Tried to move back new op lower bound from 7332554521175478272 to 7332554521064685568. Current Snapshot: MvccSnapshot[applied={T|T < 7332554521175478272}]
I20260923 14:40:43.666371 18540 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:43.666495 18540 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:43.668658 18540 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: Sending DeleteTablet for 3 replicas of tablet e6b79dc8c73144519ebdde968bd8fc8f
I20260923 14:40:43.669335 18678 tablet_service.cc:1514] Processing DeleteTablet for tablet e6b79dc8c73144519ebdde968bd8fc8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:43 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:44496
I20260923 14:40:43.669375 18818 tablet_service.cc:1514] Processing DeleteTablet for tablet e6b79dc8c73144519ebdde968bd8fc8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:43 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:59152
I20260923 14:40:43.669796 19070 tablet_replica.cc:330] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: stopping tablet replica
I20260923 14:40:43.669781 18958 tablet_service.cc:1514] Processing DeleteTablet for tablet e6b79dc8c73144519ebdde968bd8fc8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:43 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:37736
I20260923 14:40:43.670126 19070 raft_consensus.cc:2229] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:40:43.670149 19071 tablet_replica.cc:330] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: stopping tablet replica
I20260923 14:40:43.670403 19071 raft_consensus.cc:2229] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:43.670585 19070 raft_consensus.cc:2258] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:43.670689 19071 raft_consensus.cc:2258] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:43.670849 18540 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 14:40:43.671131 19069 tablet_replica.cc:330] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: stopping tablet replica
W20260923 14:40:43.671226 18540 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:43.671479 19069 raft_consensus.cc:2229] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:43.671967 19069 raft_consensus.cc:2258] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:43.672232 19071 ts_tablet_manager.cc:1905] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:43.673441 19069 ts_tablet_manager.cc:1905] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:43.675324 19071 ts_tablet_manager.cc:1918] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:40:43.675429 19071 log.cc:1196] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/e6b79dc8c73144519ebdde968bd8fc8f
I20260923 14:40:43.676326 19069 ts_tablet_manager.cc:1918] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:40:43.676481 19069 log.cc:1196] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/e6b79dc8c73144519ebdde968bd8fc8f
I20260923 14:40:43.676857 19069 ts_tablet_manager.cc:1939] T e6b79dc8c73144519ebdde968bd8fc8f P 85f1b42c4afe41bba0dfbb537d6e33c1: Deleting consensus metadata
I20260923 14:40:43.676887 19070 ts_tablet_manager.cc:1905] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:43.677866 18818 tablet_service.cc:1467] Processing CreateTablet for tablet 951664a586ab43fd80cca0581bdd0ea2 (DEFAULT_TABLE table=test-table [id=a1b998bc885943cda7e2826ea5661ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:43.678097 18818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951664a586ab43fd80cca0581bdd0ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.678079 18525 catalog_manager.cc:4841] TS 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321): tablet e6b79dc8c73144519ebdde968bd8fc8f (table test-table [id=5c2a6dccc7fa4b5cbb35ea51b4098c83]) successfully deleted
I20260923 14:40:43.679677 19070 ts_tablet_manager.cc:1918] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:40:43.679777 19070 log.cc:1196] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/e6b79dc8c73144519ebdde968bd8fc8f
I20260923 14:40:43.680078 19070 ts_tablet_manager.cc:1939] T e6b79dc8c73144519ebdde968bd8fc8f P c07dd85f8ead48a88267cdda07e6f86e: Deleting consensus metadata
I20260923 14:40:43.680375 18958 tablet_service.cc:1467] Processing CreateTablet for tablet 951664a586ab43fd80cca0581bdd0ea2 (DEFAULT_TABLE table=test-table [id=a1b998bc885943cda7e2826ea5661ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:43.680598 18958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951664a586ab43fd80cca0581bdd0ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.681264 19048 tablet_bootstrap.cc:492] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Bootstrap starting.
I20260923 14:40:43.681397 18678 tablet_service.cc:1467] Processing CreateTablet for tablet 951664a586ab43fd80cca0581bdd0ea2 (DEFAULT_TABLE table=test-table [id=a1b998bc885943cda7e2826ea5661ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:43.681630 18678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 951664a586ab43fd80cca0581bdd0ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.682144 19048 tablet_bootstrap.cc:654] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.682701 19047 tablet_bootstrap.cc:492] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Bootstrap starting.
I20260923 14:40:43.683458 19047 tablet_bootstrap.cc:654] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.683525 19049 tablet_bootstrap.cc:492] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Bootstrap starting.
I20260923 14:40:43.683655 18527 catalog_manager.cc:4841] TS c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130:34145): tablet e6b79dc8c73144519ebdde968bd8fc8f (table test-table [id=5c2a6dccc7fa4b5cbb35ea51b4098c83]) successfully deleted
I20260923 14:40:43.684196 19071 ts_tablet_manager.cc:1939] T e6b79dc8c73144519ebdde968bd8fc8f P c8da0aa7efab4e7e9496888fec7a0f9e: Deleting consensus metadata
I20260923 14:40:43.684430 19049 tablet_bootstrap.cc:654] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.685053 19047 tablet_bootstrap.cc:492] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: No bootstrap required, opened a new log
I20260923 14:40:43.685177 19047 ts_tablet_manager.cc:1397] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 14:40:43.685298 18527 catalog_manager.cc:4841] TS c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533): tablet e6b79dc8c73144519ebdde968bd8fc8f (table test-table [id=5c2a6dccc7fa4b5cbb35ea51b4098c83]) successfully deleted
I20260923 14:40:43.685622 19047 raft_consensus.cc:348] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.685736 19047 raft_consensus.cc:374] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.685779 19049 tablet_bootstrap.cc:492] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: No bootstrap required, opened a new log
I20260923 14:40:43.685775 19047 raft_consensus.cc:729] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8da0aa7efab4e7e9496888fec7a0f9e, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.685855 19049 ts_tablet_manager.cc:1397] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:40:43.685915 19047 consensus_queue.cc:260] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.686216 19047 ts_tablet_manager.cc:1428] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:43.686228 19049 raft_consensus.cc:348] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.686332 19049 raft_consensus.cc:374] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.686362 19049 raft_consensus.cc:729] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f1b42c4afe41bba0dfbb537d6e33c1, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.686461 19049 consensus_queue.cc:260] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.686674 19049 ts_tablet_manager.cc:1428] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:43.687565 19048 tablet_bootstrap.cc:492] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: No bootstrap required, opened a new log
I20260923 14:40:43.687647 19048 ts_tablet_manager.cc:1397] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260923 14:40:43.688109 19048 raft_consensus.cc:348] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.688241 19048 raft_consensus.cc:374] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.688282 19048 raft_consensus.cc:729] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07dd85f8ead48a88267cdda07e6f86e, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.688421 19048 consensus_queue.cc:260] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.688689 19048 ts_tablet_manager.cc:1428] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:40:43.702833 19055 raft_consensus.cc:482] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:43.702956 19055 raft_consensus.cc:504] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.704006 19055 leader_election.cc:288] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130:34145), c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533)
I20260923 14:40:43.708844 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.704589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:44611 (local address 127.17.4.131:33533)
0923 14:40:43.704708 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.704712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.704936 (+ 224us) server_negotiation.cc:407] Connection header received
0923 14:40:43.705022 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.705024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.705069 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.705143 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.705441 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.706163 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.707815 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.708222 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.708360 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.708417 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.708614 (+ 197us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.708717 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:40:43.708920 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.704317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:48527 (local address 127.17.4.130:34145)
0923 14:40:43.704427 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.704432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.704518 (+ 86us) server_negotiation.cc:407] Connection header received
0923 14:40:43.704712 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.704715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.704762 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.704810 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:43.705229 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.706003 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.707767 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.708401 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.708513 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.708560 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.708734 (+ 174us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.708802 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:40:43.709149 19075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.704207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34145 (local address 127.17.4.129:48527)
0923 14:40:43.704427 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.704444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.704588 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.704949 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.704954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.704973 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.705092 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.705102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.706136 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.706139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.707624 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.707633 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.708494 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.708497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.708601 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.708620 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.708684 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.708761 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":60,"thread_start_us":61,"threads_started":1}
I20260923 14:40:43.709317 19076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.704515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:33533 (local address 127.17.4.129:44611)
0923 14:40:43.704841 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.704854 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.704945 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.705168 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.705171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.705186 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:43.705324 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.705330 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.706270 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.706273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.707622 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.707633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.708352 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.708355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.708477 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.708499 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.709094 (+ 595us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.709168 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":69,"thread_start_us":95,"threads_started":1}
I20260923 14:40:43.709637 18838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951664a586ab43fd80cca0581bdd0ea2" candidate_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07dd85f8ead48a88267cdda07e6f86e" is_pre_election: true
I20260923 14:40:43.709826 18978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951664a586ab43fd80cca0581bdd0ea2" candidate_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" is_pre_election: true
I20260923 14:40:43.709918 18838 raft_consensus.cc:2454] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f1b42c4afe41bba0dfbb537d6e33c1 in term 0.
I20260923 14:40:43.709947 18978 raft_consensus.cc:2454] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f1b42c4afe41bba0dfbb537d6e33c1 in term 0.
I20260923 14:40:43.710249 18631 leader_election.cc:302] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f1b42c4afe41bba0dfbb537d6e33c1, c8da0aa7efab4e7e9496888fec7a0f9e; no voters:
I20260923 14:40:43.710489 19055 raft_consensus.cc:2781] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:43.710554 19055 raft_consensus.cc:482] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:43.710592 19055 raft_consensus.cc:3037] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.711755 19055 raft_consensus.cc:504] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.712102 19055 leader_election.cc:288] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [CANDIDATE]: Term 1 election: Requested vote from peers c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130:34145), c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533)
I20260923 14:40:43.712522 18838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951664a586ab43fd80cca0581bdd0ea2" candidate_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07dd85f8ead48a88267cdda07e6f86e"
I20260923 14:40:43.712510 18978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "951664a586ab43fd80cca0581bdd0ea2" candidate_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e"
I20260923 14:40:43.712639 18978 raft_consensus.cc:3037] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.712642 18838 raft_consensus.cc:3037] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.713596 18838 raft_consensus.cc:2454] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f1b42c4afe41bba0dfbb537d6e33c1 in term 1.
I20260923 14:40:43.713683 18978 raft_consensus.cc:2454] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f1b42c4afe41bba0dfbb537d6e33c1 in term 1.
I20260923 14:40:43.713963 18631 leader_election.cc:302] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f1b42c4afe41bba0dfbb537d6e33c1, c8da0aa7efab4e7e9496888fec7a0f9e; no voters:
I20260923 14:40:43.714244 19055 raft_consensus.cc:2781] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:43.714475 19055 raft_consensus.cc:686] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 LEADER]: Becoming Leader. State: Replica: 85f1b42c4afe41bba0dfbb537d6e33c1, State: Running, Role: LEADER
I20260923 14:40:43.714707 19055 consensus_queue.cc:237] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.716814 18541 catalog_manager.cc:5495] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } health_report { overall_health: UNKNOWN } } }
Sep 23 14:40:43 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174442, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:43.753482 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.745423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.17.4.190:36777)
0923 14:40:43.745549 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.745553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.745762 (+ 209us) server_negotiation.cc:407] Connection header received
0923 14:40:43.745905 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.745909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.745950 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.746025 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:43.746628 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.747148 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.747975 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.748180 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.748286 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.750444 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:43.750447 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:43.750450 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:43.750475 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:43.751816 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.752265 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.752269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.752270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.752360 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:43.752627 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:43.752630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:43.752632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:43.752793 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:43.752898 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.753173 (+ 275us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.753326 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":56}
I20260923 14:40:43.753484 19084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.745356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36777 (local address 127.0.0.1:41730)
0923 14:40:43.745677 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.745688 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.745818 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.746045 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.746048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.746421 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:43.746500 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.746505 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.747256 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.747262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.747872 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.747880 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.748286 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.748290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.748365 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.748985 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:43.748997 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:43.750323 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:43.751924 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.751934 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.751941 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.752152 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.752453 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:43.752457 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:43.752459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:43.752538 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:43.752898 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:43.752906 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:43.753013 (+ 107us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.753129 (+ 116us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.753273 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":98,"threads_started":1}
I20260923 14:40:43.757254 18541 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:41730:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 14:40:43.757982 18541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:43.762679 18678 tablet_service.cc:1467] Processing CreateTablet for tablet 65adf2ebad2f430280386ae1c7cd32dd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e709cd18df594c91aa30b6c197a8ac08]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:40:43.762740 18818 tablet_service.cc:1467] Processing CreateTablet for tablet 65adf2ebad2f430280386ae1c7cd32dd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e709cd18df594c91aa30b6c197a8ac08]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:40:43.763072 18818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65adf2ebad2f430280386ae1c7cd32dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.763072 18678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65adf2ebad2f430280386ae1c7cd32dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.762940 18958 tablet_service.cc:1467] Processing CreateTablet for tablet 65adf2ebad2f430280386ae1c7cd32dd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e709cd18df594c91aa30b6c197a8ac08]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:40:43.763353 18958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65adf2ebad2f430280386ae1c7cd32dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:43.765918 19049 tablet_bootstrap.cc:492] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: Bootstrap starting.
I20260923 14:40:43.765938 19048 tablet_bootstrap.cc:492] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: Bootstrap starting.
I20260923 14:40:43.766645 19048 tablet_bootstrap.cc:654] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.766858 19049 tablet_bootstrap.cc:654] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.767724 19048 tablet_bootstrap.cc:492] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: No bootstrap required, opened a new log
I20260923 14:40:43.767819 19048 ts_tablet_manager.cc:1397] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260923 14:40:43.768273 19048 raft_consensus.cc:348] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.768395 19048 raft_consensus.cc:374] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.768435 19048 raft_consensus.cc:729] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07dd85f8ead48a88267cdda07e6f86e, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.768554 19049 tablet_bootstrap.cc:492] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: No bootstrap required, opened a new log
I20260923 14:40:43.768576 19048 consensus_queue.cc:260] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.768642 19049 ts_tablet_manager.cc:1397] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 14:40:43.768823 19048 ts_tablet_manager.cc:1428] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:43.769012 19057 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.769034 19049 raft_consensus.cc:348] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.769133 19049 raft_consensus.cc:374] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.769136 19057 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.769169 19049 raft_consensus.cc:729] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f1b42c4afe41bba0dfbb537d6e33c1, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.769286 19049 consensus_queue.cc:260] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.769518 19049 ts_tablet_manager.cc:1428] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:43.769812 19055 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.769932 19055 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.770854 19047 tablet_bootstrap.cc:492] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: Bootstrap starting.
I20260923 14:40:43.771947 19047 tablet_bootstrap.cc:654] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:43.773348 19047 tablet_bootstrap.cc:492] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: No bootstrap required, opened a new log
I20260923 14:40:43.773433 19047 ts_tablet_manager.cc:1397] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 14:40:43.773869 19047 raft_consensus.cc:348] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.773998 19047 raft_consensus.cc:374] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:43.774029 19047 raft_consensus.cc:729] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8da0aa7efab4e7e9496888fec7a0f9e, State: Initialized, Role: FOLLOWER
I20260923 14:40:43.774181 19047 consensus_queue.cc:260] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.774410 19053 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.774529 19053 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.774735 19047 ts_tablet_manager.cc:1428] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260923 14:40:43.776607 19025 tablet.cc:2369] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:40:43.824015 18885 tablet.cc:2369] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:40:43.887106 19057 raft_consensus.cc:482] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:43.887269 19057 raft_consensus.cc:504] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.887900 19057 leader_election.cc:288] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321), c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533)
I20260923 14:40:43.888316 18698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65adf2ebad2f430280386ae1c7cd32dd" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" is_pre_election: true
I20260923 14:40:43.888330 18978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65adf2ebad2f430280386ae1c7cd32dd" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" is_pre_election: true
I20260923 14:40:43.888481 18698 raft_consensus.cc:2454] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 0.
I20260923 14:40:43.888489 18978 raft_consensus.cc:2454] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 0.
I20260923 14:40:43.888767 18769 leader_election.cc:302] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f1b42c4afe41bba0dfbb537d6e33c1, c07dd85f8ead48a88267cdda07e6f86e; no voters:
I20260923 14:40:43.888953 19057 raft_consensus.cc:2781] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:43.889011 19057 raft_consensus.cc:482] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:43.889047 19057 raft_consensus.cc:3037] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.890024 19057 raft_consensus.cc:504] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.890362 19057 leader_election.cc:288] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 election: Requested vote from peers 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321), c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533)
I20260923 14:40:43.890681 18698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65adf2ebad2f430280386ae1c7cd32dd" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1"
I20260923 14:40:43.890799 18698 raft_consensus.cc:3037] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.890811 18978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65adf2ebad2f430280386ae1c7cd32dd" candidate_uuid: "c07dd85f8ead48a88267cdda07e6f86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e"
I20260923 14:40:43.890959 18978 raft_consensus.cc:3037] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:43.891914 18698 raft_consensus.cc:2454] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 1.
I20260923 14:40:43.891943 18978 raft_consensus.cc:2454] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07dd85f8ead48a88267cdda07e6f86e in term 1.
I20260923 14:40:43.892180 18769 leader_election.cc:302] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f1b42c4afe41bba0dfbb537d6e33c1, c07dd85f8ead48a88267cdda07e6f86e; no voters:
I20260923 14:40:43.892436 19057 raft_consensus.cc:2781] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:43.892535 19057 raft_consensus.cc:686] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [term 1 LEADER]: Becoming Leader. State: Replica: c07dd85f8ead48a88267cdda07e6f86e, State: Running, Role: LEADER
I20260923 14:40:43.892668 19057 consensus_queue.cc:237] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } }
I20260923 14:40:43.893319 19054 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: TxnStatusTablet state changed. Reason: New leader c07dd85f8ead48a88267cdda07e6f86e. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.893433 19054 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:40:43.893678 19089 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 14:40:43.893826 19089 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 14:40:43.894255 18541 catalog_manager.cc:5495] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e reported cstate change: term changed from 0 to 1, leader changed from <none> to c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130). New cstate: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } health_report { overall_health: UNKNOWN } } }
I20260923 14:40:43.926973 19084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.923163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34145 (local address 127.0.0.1:59170)
0923 14:40:43.923376 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.923389 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.923523 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.923855 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.923857 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.923864 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:43.923951 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.923955 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.924955 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.924957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.925654 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.925681 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.926254 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.926256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.926328 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.926368 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.926665 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.926675 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.926744 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.926872 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260923 14:40:43.926962 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.923265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.17.4.130:34145)
0923 14:40:43.923400 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.923405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.923425 (+ 20us) server_negotiation.cc:407] Connection header received
0923 14:40:43.923672 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.923676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.923729 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.923838 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:43.924049 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.924834 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.925798 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.926154 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.926259 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.926486 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.926570 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.926656 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.926754 (+ 98us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.926822 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 14:40:43.929786 18698 raft_consensus.cc:1261] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Refusing update from remote peer c07dd85f8ead48a88267cdda07e6f86e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:43.929788 18978 raft_consensus.cc:1261] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Refusing update from remote peer c07dd85f8ead48a88267cdda07e6f86e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:43.930176 19057 consensus_queue.cc:1035] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:43.930346 19054 consensus_queue.cc:1035] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:43.932232 19053 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: TxnStatusTablet state changed. Reason: New leader c07dd85f8ead48a88267cdda07e6f86e. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.932364 19053 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.932847 19055 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: TxnStatusTablet state changed. Reason: New leader c07dd85f8ead48a88267cdda07e6f86e. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.932955 19055 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.933365 19057 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.933498 19057 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:40:43.933810 19060 mvcc.cc:205] Tried to move back new op lower bound from 7332554522332000256 to 7332554522185699328. Current Snapshot: MvccSnapshot[applied={T|T < 7332554522332000256 or (T in {7332554522332000256})}]
I20260923 14:40:43.934931 19055 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.935034 19055 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P 85f1b42c4afe41bba0dfbb537d6e33c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.937646 19054 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.937757 19054 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c07dd85f8ead48a88267cdda07e6f86e: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:40:43.939072 19053 tablet_replica.cc:439] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c07dd85f8ead48a88267cdda07e6f86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f1b42c4afe41bba0dfbb537d6e33c1" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44321 } } peers { permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 } } peers { permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 } } }
I20260923 14:40:43.939174 19053 tablet_replica.cc:442] T 65adf2ebad2f430280386ae1c7cd32dd P c8da0aa7efab4e7e9496888fec7a0f9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:43.942880 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.938864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.17.4.129:44321)
0923 14:40:43.938960 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.938964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.938981 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:40:43.939061 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.939063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.939123 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.939236 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:43.939586 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.940388 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.941537 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.941753 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.941831 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.942094 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.942486 (+ 392us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.942568 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.942665 (+ 97us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.942728 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260923 14:40:43.953258 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.949588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:49377 (local address 127.17.4.130:34145)
0923 14:40:43.949693 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.949697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.949860 (+ 163us) server_negotiation.cc:407] Connection header received
0923 14:40:43.949935 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.949938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.949981 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.950056 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:43.950275 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.950984 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.951991 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.952342 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.952454 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.952731 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.952806 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.952877 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.953079 (+ 202us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.953131 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:40:43.953492 19095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.949520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34145 (local address 127.17.4.129:49377)
0923 14:40:43.949781 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.949794 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.949871 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.950069 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.950071 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.950076 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:43.950181 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.950185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.951142 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.951144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.951876 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.951886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.952477 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.952480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.952556 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.952596 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.952968 (+ 372us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.952975 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.953042 (+ 67us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.953103 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260923 14:40:43.959828 18838 raft_consensus.cc:1261] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Refusing update from remote peer 85f1b42c4afe41bba0dfbb537d6e33c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:43.960203 18978 raft_consensus.cc:1261] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Refusing update from remote peer 85f1b42c4afe41bba0dfbb537d6e33c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:43.960327 19077 consensus_queue.cc:1035] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07dd85f8ead48a88267cdda07e6f86e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:43.960575 19055 consensus_queue.cc:1035] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8da0aa7efab4e7e9496888fec7a0f9e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:43.981648 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.978315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:51775 (local address 127.17.4.129:44321)
0923 14:40:43.978405 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:43.978408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:43.978418 (+ 10us) server_negotiation.cc:407] Connection header received
0923 14:40:43.978449 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:43.978451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:43.978485 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:43.978538 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:43.978818 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.979279 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.980494 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.980780 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.980904 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.981255 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.981328 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.981398 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:43.981483 (+ 85us) server_negotiation.cc:299] Negotiation successful
0923 14:40:43.981523 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 14:40:43.981696 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:43.977889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:44321 (local address 127.17.4.130:51775)
0923 14:40:43.978159 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:43.978172 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:43.978256 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:43.978583 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:43.978586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:43.978595 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:43.978702 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.978708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.979382 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.979386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.980375 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:43.980386 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:43.980983 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:43.980988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:43.981076 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:43.981119 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:43.981411 (+ 292us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:43.981419 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 14:40:43.981474 (+ 55us) client_negotiation.cc:240] Negotiation successful
0923 14:40:43.981545 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260923 14:40:44.007359 18541 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:44.007560 18541 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:44.009792 18541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd5da8fd9ff14537b4fe0a2bd88a467b: Sending DeleteTablet for 3 replicas of tablet 951664a586ab43fd80cca0581bdd0ea2
I20260923 14:40:44.010381 18678 tablet_service.cc:1514] Processing DeleteTablet for tablet 951664a586ab43fd80cca0581bdd0ea2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:44 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:44496
I20260923 14:40:44.010557 19069 tablet_replica.cc:330] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: stopping tablet replica
I20260923 14:40:44.010661 19069 raft_consensus.cc:2229] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:40:44.010872 18958 tablet_service.cc:1514] Processing DeleteTablet for tablet 951664a586ab43fd80cca0581bdd0ea2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:44 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:37736
I20260923 14:40:44.010977 19069 raft_consensus.cc:2258] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:44.011067 19071 tablet_replica.cc:330] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: stopping tablet replica
I20260923 14:40:44.011173 19071 raft_consensus.cc:2229] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:44.011289 19071 raft_consensus.cc:2258] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:44.011821 19069 ts_tablet_manager.cc:1905] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:44.012017 19071 ts_tablet_manager.cc:1905] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:44.012567 18818 tablet_service.cc:1514] Processing DeleteTablet for tablet 951664a586ab43fd80cca0581bdd0ea2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:44 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:59152
I20260923 14:40:44.014485 19071 ts_tablet_manager.cc:1918] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:44.014585 19071 log.cc:1196] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/951664a586ab43fd80cca0581bdd0ea2
I20260923 14:40:44.014680 19069 ts_tablet_manager.cc:1918] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:44.014771 19069 log.cc:1196] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/951664a586ab43fd80cca0581bdd0ea2
I20260923 14:40:44.014899 19071 ts_tablet_manager.cc:1939] T 951664a586ab43fd80cca0581bdd0ea2 P c8da0aa7efab4e7e9496888fec7a0f9e: Deleting consensus metadata
I20260923 14:40:44.015040 19069 ts_tablet_manager.cc:1939] T 951664a586ab43fd80cca0581bdd0ea2 P 85f1b42c4afe41bba0dfbb537d6e33c1: Deleting consensus metadata
I20260923 14:40:44.015535 19070 tablet_replica.cc:330] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: stopping tablet replica
I20260923 14:40:44.015580 18527 catalog_manager.cc:4841] TS c8da0aa7efab4e7e9496888fec7a0f9e (127.17.4.131:33533): tablet 951664a586ab43fd80cca0581bdd0ea2 (table test-table [id=a1b998bc885943cda7e2826ea5661ad8]) successfully deleted
I20260923 14:40:44.015656 19070 raft_consensus.cc:2229] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:44.015735 18525 catalog_manager.cc:4841] TS 85f1b42c4afe41bba0dfbb537d6e33c1 (127.17.4.129:44321): tablet 951664a586ab43fd80cca0581bdd0ea2 (table test-table [id=a1b998bc885943cda7e2826ea5661ad8]) successfully deleted
I20260923 14:40:44.015800 19070 raft_consensus.cc:2258] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:44.016628 19070 ts_tablet_manager.cc:1905] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:44.019577 19070 ts_tablet_manager.cc:1918] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:44.019659 19070 log.cc:1196] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/951664a586ab43fd80cca0581bdd0ea2
I20260923 14:40:44.019945 19070 ts_tablet_manager.cc:1939] T 951664a586ab43fd80cca0581bdd0ea2 P c07dd85f8ead48a88267cdda07e6f86e: Deleting consensus metadata
I20260923 14:40:44.020959 18527 catalog_manager.cc:4841] TS c07dd85f8ead48a88267cdda07e6f86e (127.17.4.130:34145): tablet 951664a586ab43fd80cca0581bdd0ea2 (table test-table [id=a1b998bc885943cda7e2826ea5661ad8]) successfully deleted
Sep 23 14:40:44 dist-test-slave-54kg krb5kdc[18496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174443, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:44.028120 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:44.013053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44504 (local address 127.17.4.129:44321)
0923 14:40:44.015657 (+ 2604us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:44.015661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:44.016118 (+ 457us) server_negotiation.cc:407] Connection header received
0923 14:40:44.016309 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:44.016312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:44.016356 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:44.016407 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:44.017377 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:44.018194 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:44.019408 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:44.019756 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:44.019845 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:44.023694 (+ 3849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:44.023729 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:44.023744 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:44.023788 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:44.025858 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:44.026501 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:44.026507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:44.026508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:44.026592 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:44.026928 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:44.026931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:44.026933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:44.027202 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:44.027416 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:44.027809 (+ 393us) server_negotiation.cc:299] Negotiation successful
0923 14:40:44.027947 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2534}
W20260923 14:40:44.028546 18738 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44504
I20260923 14:40:44.039191 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:44.030256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.17.4.190:36777)
0923 14:40:44.030382 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:44.030386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:44.030850 (+ 464us) server_negotiation.cc:407] Connection header received
0923 14:40:44.030967 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:44.030970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:44.031019 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:44.031098 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:44.031896 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:44.032705 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:44.033851 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:44.034196 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:44.034294 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:44.035830 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:44.035834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:44.035836 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:44.035859 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:44.037433 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:44.037945 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:44.037949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:44.037951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:44.038033 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:44.038325 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:44.038328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:44.038330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:44.038527 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:44.038655 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:44.038920 (+ 265us) server_negotiation.cc:299] Negotiation successful
0923 14:40:44.039037 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260923 14:40:44.039669 18541 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41738
I20260923 14:40:44.040974 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18613
I20260923 14:40:44.048616 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18753
I20260923 14:40:44.055183 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18893
I20260923 14:40:44.060719 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 18509
2026-09-23T14:40:44Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2526 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:44 dist-test-slave-54kg krb5kdc[19110](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:44 dist-test-slave-54kg krb5kdc[19110](info): set up 2 sockets
Sep 23 14:40:44 dist-test-slave-54kg krb5kdc[19110](info): commencing operation
krb5kdc: starting...
W20260923 14:40:45.080554 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.998s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:45.196762 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36827
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:36827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:45.299657 19123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:45.299914 19123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:45.300000 19123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:45.304044 19123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:45.304091 19123 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 14:40:45.304108 19123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:45.304126 19123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:45.304178 19123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:45.304210 19123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:45.309096 19123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:36827
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:45.310075 19123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:45.311058 19123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:45.319309 19131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:45.319458 19123 server_base.cc:1034] running on GCE node
W20260923 14:40:45.319269 19129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:45.319270 19128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:45.320155 19123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:45.321118 19123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:45.322325 19123 hybrid_clock.cc:648] HybridClock initialized: now 1790174445322288 us; error 47 us; skew 500 ppm
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:45.325054 19123 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:45.325876 19123 webserver.cc:460] Webserver started at http://127.17.4.190:42683/ using document root <none> and password file <none>
I20260923 14:40:45.326385 19123 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:45.326440 19123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:45.326673 19123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:45.328603 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "10c02bff22cb42529ad1efe2d1589974"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "d35be67a9865b7123a0489f568543a2b"
server_key_iv: "f8ba7c1267fedc2a39fbd0e247694f6d"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.329141 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "10c02bff22cb42529ad1efe2d1589974"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "d35be67a9865b7123a0489f568543a2b"
server_key_iv: "f8ba7c1267fedc2a39fbd0e247694f6d"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.332717 19123 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:45.334964 19138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:45.336122 19123 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:45.336265 19123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "10c02bff22cb42529ad1efe2d1589974"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "d35be67a9865b7123a0489f568543a2b"
server_key_iv: "f8ba7c1267fedc2a39fbd0e247694f6d"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.336369 19123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:45.364735 19123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:45.367766 19123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:45.367986 19123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:45.375433 19123 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:36827
I20260923 14:40:45.375455 19200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:36827 every 8 connection(s)
I20260923 14:40:45.376334 19123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:45.378916 19201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:45.382120 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 19123
I20260923 14:40:45.382208 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:45.382499 17426 external_mini_cluster.cc:1428] Setting key f971cc50b24f9d38102ea3df427e1001
I20260923 14:40:45.384923 19201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Bootstrap starting.
I20260923 14:40:45.387446 19201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:45.388270 19201 log.cc:824] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:45.390213 19201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: No bootstrap required, opened a new log
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:45.393898 19201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c02bff22cb42529ad1efe2d1589974" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36827 } }
I20260923 14:40:45.394094 19201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:45.394168 19201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c02bff22cb42529ad1efe2d1589974, State: Initialized, Role: FOLLOWER
I20260923 14:40:45.394621 19201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c02bff22cb42529ad1efe2d1589974" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36827 } }
I20260923 14:40:45.394797 19201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:45.394871 19201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:45.394980 19201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:45.396044 19201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c02bff22cb42529ad1efe2d1589974" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36827 } }
I20260923 14:40:45.396376 19201 leader_election.cc:302] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10c02bff22cb42529ad1efe2d1589974; no voters:
I20260923 14:40:45.396670 19201 leader_election.cc:288] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:45.396770 19206 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:45.396981 19206 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [term 1 LEADER]: Becoming Leader. State: Replica: 10c02bff22cb42529ad1efe2d1589974, State: Running, Role: LEADER
I20260923 14:40:45.397096 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.383903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54996 (local address 127.17.4.190:36827)
0923 14:40:45.384297 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:45.384314 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:45.384354 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:40:45.385123 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:45.385149 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:45.385544 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:45.385888 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:45.386484 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.387930 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.388836 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.389448 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.389588 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.392326 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:45.392331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:45.392343 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:45.392368 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:45.394038 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.394523 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.394527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.394532 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.394630 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.394944 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.394947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.394949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.395433 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:45.395633 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:45.395868 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 14:40:45.396153 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":102,"threads_started":1}
I20260923 14:40:45.397256 19206 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c02bff22cb42529ad1efe2d1589974" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36827 } }
I20260923 14:40:45.397854 19201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:45.398330 19206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10c02bff22cb42529ad1efe2d1589974. Latest consensus state: current_term: 1 leader_uuid: "10c02bff22cb42529ad1efe2d1589974" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c02bff22cb42529ad1efe2d1589974" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36827 } } }
I20260923 14:40:45.398430 19206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:45.398716 19207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10c02bff22cb42529ad1efe2d1589974" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10c02bff22cb42529ad1efe2d1589974" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36827 } } }
I20260923 14:40:45.398814 19207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974 [sys.catalog]: This master's current role is: LEADER
W20260923 14:40:45.402356 19221 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:40:45.402447 19221 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:40:45.402514 19210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:45.403337 19210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:45.408692 19210 catalog_manager.cc:1347] Generated new cluster ID: 15c275b035b44fb196e4279f61528ddb
I20260923 14:40:45.408748 19210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:45.428535 19210 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:45.429821 19210 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:45.437844 19210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Generated new TSK 0
I20260923 14:40:45.438555 19210 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:45.464900 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36827
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:45.571466 19227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:45.571686 19227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:45.571728 19227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:45.575551 19227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:45.575599 19227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:45.575634 19227 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 14:40:45.575649 19227 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:40:45.575676 19227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:45.580755 19227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:36827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:45.581712 19227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:45.582683 19227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:45.591856 19233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:45.591822 19232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:45.592180 19227 server_base.cc:1034] running on GCE node
W20260923 14:40:45.592238 19235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:45.592653 19227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:45.593250 19227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:45.594446 19227 hybrid_clock.cc:648] HybridClock initialized: now 1790174445594428 us; error 29 us; skew 500 ppm
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:45.597050 19227 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:45.597870 19227 webserver.cc:460] Webserver started at http://127.17.4.129:42799/ using document root <none> and password file <none>
I20260923 14:40:45.598446 19227 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:45.598510 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:45.598666 19227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:45.600750 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "5a7857c2107e4829abb5b2c906a842b8"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "1dfc800e0dda2eebf38b931ff1329d67"
server_key_iv: "85633cb89f2ceec066fe688f5b291ff9"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.601244 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "5a7857c2107e4829abb5b2c906a842b8"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "1dfc800e0dda2eebf38b931ff1329d67"
server_key_iv: "85633cb89f2ceec066fe688f5b291ff9"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.604631 19227 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:45.606892 19242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:45.608260 19227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:45.608381 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "5a7857c2107e4829abb5b2c906a842b8"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "1dfc800e0dda2eebf38b931ff1329d67"
server_key_iv: "85633cb89f2ceec066fe688f5b291ff9"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.608480 19227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:45.625779 19227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:45.628393 19227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:45.628590 19227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:45.629864 19227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:45.629935 19227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:45.629997 19227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:45.630036 19227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:45.640687 19227 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:39489
I20260923 14:40:45.641284 19357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:39489 every 8 connection(s)
I20260923 14:40:45.641678 19227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:40:45.644630 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.630702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:48987 (local address 127.17.4.190:36827)
0923 14:40:45.630824 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:45.630828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:45.631801 (+ 973us) server_negotiation.cc:407] Connection header received
0923 14:40:45.632883 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:45.632888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:45.632951 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:45.633013 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:45.634634 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.635532 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.636893 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.637141 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.637261 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.640121 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:45.640125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:45.640127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:45.640156 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:45.641850 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.642762 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.642768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.642771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.642929 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.643368 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.643373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.643377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.643592 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:45.643709 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:45.644344 (+ 635us) server_negotiation.cc:299] Negotiation successful
0923 14:40:45.644456 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:40:45.645426 19251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.631190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.17.4.129:48987)
0923 14:40:45.631649 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:45.631685 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:45.632642 (+ 957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:45.633442 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:45.633451 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:45.633880 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:45.634502 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.634523 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.635647 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.635650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.636780 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.636789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.637312 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.637316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.637487 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.638047 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:45.638062 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:45.639936 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:45.642006 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.642013 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.642028 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.642557 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.643054 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.643059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.643063 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.643242 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.643717 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:45.643725 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:45.644048 (+ 323us) client_negotiation.cc:769] Sending connection context
0923 14:40:45.644269 (+ 221us) client_negotiation.cc:240] Negotiation successful
0923 14:40:45.644559 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":139,"threads_started":1}
I20260923 14:40:45.647145 19358 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36827
I20260923 14:40:45.647354 19358 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:45.647927 19358 heartbeater.cc:511] Master 127.17.4.190:36827 requested a full tablet report, sending...
I20260923 14:40:45.649924 19154 ts_manager.cc:194] Registered new tserver with Master: 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489)
I20260923 14:40:45.650410 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 19227
I20260923 14:40:45.650530 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:45.650825 17426 external_mini_cluster.cc:1428] Setting key 37d6aa2427f004c1d9a1b935db18b74d
I20260923 14:40:45.651397 19154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:48987
I20260923 14:40:45.656160 19364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.649155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.17.4.129:43529)
0923 14:40:45.649392 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:45.649407 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:45.649493 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:45.649703 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:45.649706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:45.649883 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:45.649963 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.649968 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.650797 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.650800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.651572 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.651581 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.652217 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.652221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.652314 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.652820 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:45.652833 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:45.653199 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:45.654707 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.654712 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.654716 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.654987 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.655271 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.655273 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.655274 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.655344 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.655738 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:45.655740 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:45.655868 (+ 128us) client_negotiation.cc:769] Sending connection context
0923 14:40:45.655946 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:40:45.656037 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260923 14:40:45.656383 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.649286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:43529 (local address 127.17.4.190:36827)
0923 14:40:45.649381 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:45.649386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:45.649455 (+ 69us) server_negotiation.cc:407] Connection header received
0923 14:40:45.649561 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:45.649564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:45.649600 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:45.649691 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:45.650110 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.650680 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.651692 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.652018 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.652086 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.653358 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:45.653362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:45.653364 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:45.653387 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:45.654606 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.655096 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.655102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.655107 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.655188 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.655429 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.655434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.655439 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.655652 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:45.655747 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:45.656034 (+ 287us) server_negotiation.cc:299] Negotiation successful
0923 14:40:45.656151 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:45.678306 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36827
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:45.784139 19367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:45.784372 19367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:45.784417 19367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:45.788225 19367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:45.788276 19367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:45.788313 19367 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 14:40:45.788326 19367 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:40:45.788386 19367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:45.793362 19367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:36827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:45.794319 19367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:45.795258 19367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:45.804888 19375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:45.804898 19373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:45.805049 19367 server_base.cc:1034] running on GCE node
W20260923 14:40:45.804898 19372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:45.805516 19367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:45.806087 19367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:45.807237 19367 hybrid_clock.cc:648] HybridClock initialized: now 1790174445807227 us; error 22 us; skew 500 ppm
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:45.815904 19367 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:45.816735 19367 webserver.cc:460] Webserver started at http://127.17.4.130:43827/ using document root <none> and password file <none>
I20260923 14:40:45.817253 19367 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:45.817317 19367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:45.817469 19367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:45.819419 19367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "6e922fd65d184083b9f86632f8194512"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "cc7bb4ad1efe3c164dd52b6427705ae4"
server_key_iv: "48e68353433c1a5cbdef74031daf6386"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.819962 19367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "6e922fd65d184083b9f86632f8194512"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "cc7bb4ad1efe3c164dd52b6427705ae4"
server_key_iv: "48e68353433c1a5cbdef74031daf6386"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.823438 19367 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:40:45.825857 19382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:45.826982 19367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:40:45.827078 19367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "6e922fd65d184083b9f86632f8194512"
format_stamp: "Formatted at 2026-09-23 14:40:45 on dist-test-slave-54kg"
server_key: "cc7bb4ad1efe3c164dd52b6427705ae4"
server_key_iv: "48e68353433c1a5cbdef74031daf6386"
server_key_version: "encryptionkey@0"
I20260923 14:40:45.827157 19367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:45.851155 19367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:45.853868 19367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:45.854013 19367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:45.855399 19367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:45.855446 19367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:45.855497 19367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:45.855549 19367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:40:45 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:45.865954 19367 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39489
I20260923 14:40:45.866050 19497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39489 every 8 connection(s)
I20260923 14:40:45.866950 19367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:45.869186 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.856089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:51525 (local address 127.17.4.190:36827)
0923 14:40:45.856245 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:45.856252 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:45.857517 (+ 1265us) server_negotiation.cc:407] Connection header received
0923 14:40:45.858994 (+ 1477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:45.858997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:45.859070 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:45.859256 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:45.860879 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.861543 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.862852 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.863204 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.863344 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.865718 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:45.865723 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:45.865726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:45.865757 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:45.867282 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.867905 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.867912 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.867916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.868006 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.868325 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.868327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.868328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.868490 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:45.868561 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:45.868984 (+ 423us) server_negotiation.cc:299] Negotiation successful
0923 14:40:45.869073 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 14:40:45.869954 19391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.856896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.17.4.130:51525)
0923 14:40:45.857365 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:45.857418 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:45.858748 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:45.859452 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:45.859464 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:45.859986 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:45.860681 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.860702 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.861662 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.861667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.862716 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.862726 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.863355 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.863357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.863486 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.864085 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:45.864105 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:45.865553 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:45.867398 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.867404 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.867418 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.867760 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.868097 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.868099 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.868101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.868230 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.868572 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:45.868577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:45.868776 (+ 199us) client_negotiation.cc:769] Sending connection context
0923 14:40:45.868928 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 14:40:45.869146 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":99,"threads_started":1}
I20260923 14:40:45.871093 19498 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36827
I20260923 14:40:45.871241 19498 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:45.871695 19498 heartbeater.cc:511] Master 127.17.4.190:36827 requested a full tablet report, sending...
I20260923 14:40:45.872812 19155 ts_manager.cc:194] Registered new tserver with Master: 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489)
I20260923 14:40:45.873616 19155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:51525
I20260923 14:40:45.874190 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 19367
I20260923 14:40:45.874312 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:45.874590 17426 external_mini_cluster.cc:1428] Setting key e6519e8734d4163c67ff014e0d5a70ce
I20260923 14:40:45.882027 19504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.873258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.17.4.130:38705)
0923 14:40:45.873628 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:45.873639 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:45.873753 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:45.874989 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:45.874992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:45.875193 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:45.875347 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.875354 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.876257 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.876260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.876798 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:45.876804 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.877455 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.877460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:45.877577 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.878069 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:45.878086 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:45.878553 (+ 467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:45.880515 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.880517 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.880519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.880695 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.880985 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:45.880987 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:45.880988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:45.881057 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:45.881583 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:45.881585 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:45.881656 (+ 71us) client_negotiation.cc:769] Sending connection context
0923 14:40:45.881731 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 14:40:45.881828 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":87,"threads_started":1}
I20260923 14:40:45.882192 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:45.873386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:38705 (local address 127.17.4.190:36827)
0923 14:40:45.873504 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:45.873508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:45.873737 (+ 229us) server_negotiation.cc:407] Connection header received
0923 14:40:45.873840 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:45.873845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:45.873890 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:45.873992 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:45.875479 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.876133 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.876908 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:45.877319 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:45.877440 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:45.878722 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:45.878729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:45.878735 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:45.878767 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:45.880411 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.880794 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.880799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.880802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.880891 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:45.881149 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:45.881156 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:45.881159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:45.881480 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:45.881590 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:45.881823 (+ 233us) server_negotiation.cc:299] Negotiation successful
0923 14:40:45.881950 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:45.902303 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36827
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:46.025249 19507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:46.025478 19507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:46.025521 19507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:46.029421 19507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:46.029469 19507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:46.029505 19507 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 14:40:46.029551 19507 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:40:46.029604 19507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:46.034940 19507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:36827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:46.035902 19507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:46.036849 19507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:46.046446 19513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:46.046443 19512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:46.046623 19507 server_base.cc:1034] running on GCE node
W20260923 14:40:46.046890 19515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:46.047291 19507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:46.047950 19507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:46.049122 19507 hybrid_clock.cc:648] HybridClock initialized: now 1790174446049104 us; error 51 us; skew 500 ppm
Sep 23 14:40:46 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174446, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:46.057322 19507 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:46.058147 19507 webserver.cc:460] Webserver started at http://127.17.4.131:39979/ using document root <none> and password file <none>
I20260923 14:40:46.058693 19507 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:46.058782 19507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:46.059020 19507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:46.061005 19507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "e5b59f93848741eeba4f1b9de6d02d3b"
format_stamp: "Formatted at 2026-09-23 14:40:46 on dist-test-slave-54kg"
server_key: "b70923a51f9e71757dade4b486f24f01"
server_key_iv: "d587dbfaa726499092d207266abb26c5"
server_key_version: "encryptionkey@0"
I20260923 14:40:46.061573 19507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "e5b59f93848741eeba4f1b9de6d02d3b"
format_stamp: "Formatted at 2026-09-23 14:40:46 on dist-test-slave-54kg"
server_key: "b70923a51f9e71757dade4b486f24f01"
server_key_iv: "d587dbfaa726499092d207266abb26c5"
server_key_version: "encryptionkey@0"
I20260923 14:40:46.065114 19507 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:46.067516 19522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:46.068645 19507 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:46.068778 19507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "e5b59f93848741eeba4f1b9de6d02d3b"
format_stamp: "Formatted at 2026-09-23 14:40:46 on dist-test-slave-54kg"
server_key: "b70923a51f9e71757dade4b486f24f01"
server_key_iv: "d587dbfaa726499092d207266abb26c5"
server_key_version: "encryptionkey@0"
I20260923 14:40:46.068882 19507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:46.088095 19507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:46.090932 19507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:46.091140 19507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:46.092829 19507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:46.092897 19507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:46.092963 19507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:46.093015 19507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:40:46 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174446, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:46.103708 19507 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:41489
I20260923 14:40:46.104472 19637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:41489 every 8 connection(s)
I20260923 14:40:46.104598 19507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:46.106340 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.093451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:47527 (local address 127.17.4.190:36827)
0923 14:40:46.093603 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.093609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.094890 (+ 1281us) server_negotiation.cc:407] Connection header received
0923 14:40:46.095959 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.095963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.096021 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.096099 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:46.097180 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.097966 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.099550 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.099899 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.100019 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.102567 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:46.102570 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:46.102573 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:46.102604 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:46.104257 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.104838 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.104843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.104845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.104929 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.105269 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.105274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.105276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.105479 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:46.105581 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.106049 (+ 468us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.106161 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 14:40:46.107062 19531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.094270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.17.4.131:47527)
0923 14:40:46.094723 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.094771 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.095686 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.096261 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.096267 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.096583 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:46.097028 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.097041 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.098087 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.098093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.099388 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.099419 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.100084 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.100088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.100295 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.100929 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:46.100947 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:46.102404 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:46.104380 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:46.104388 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:46.104402 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:46.104721 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:46.105026 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:46.105029 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:46.105031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:46.105185 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:46.105589 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:46.105598 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:46.105827 (+ 229us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.106010 (+ 183us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.106297 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":128,"threads_started":1}
I20260923 14:40:46.108047 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 19507
I20260923 14:40:46.108161 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:40:46.108310 19638 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36827
I20260923 14:40:46.108542 17426 external_mini_cluster.cc:1428] Setting key 9d23098f35b45b5f5787ce9eacd8652b
I20260923 14:40:46.108565 19638 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:46.109102 19638 heartbeater.cc:511] Master 127.17.4.190:36827 requested a full tablet report, sending...
I20260923 14:40:46.110116 19154 ts_manager.cc:194] Registered new tserver with Master: e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:46.110833 19154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:47527
I20260923 14:40:46.117586 19644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.110992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.17.4.131:49891)
0923 14:40:46.111249 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.111264 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.111368 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.111646 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.111648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.111890 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:46.111984 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.111990 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.112952 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.112955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.113509 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.113517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.113916 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.113918 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.113999 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.114487 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:46.114500 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:46.114803 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:46.116317 (+ 1514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:46.116320 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:46.116321 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:46.116501 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:46.116756 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:46.116762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:46.116767 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:46.116856 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:46.117173 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:46.117175 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:46.117248 (+ 73us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.117338 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.117441 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":94,"threads_started":1}
I20260923 14:40:46.117586 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.111040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:49891 (local address 127.17.4.190:36827)
0923 14:40:46.111147 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.111151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.111346 (+ 195us) server_negotiation.cc:407] Connection header received
0923 14:40:46.111469 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.111472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.111516 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.111631 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:46.112095 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.112816 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.113609 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.113811 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.113898 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.114914 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:46.114916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:46.114918 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:46.114933 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:46.116219 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.116583 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.116586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.116587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.116654 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.116939 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.116941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.116943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.117094 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:46.117167 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.117395 (+ 228us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.117479 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:40:46.122069 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 14:40:46 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 14:40:46 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:46.146996 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.139190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55008 (local address 127.17.4.190:36827)
0923 14:40:46.139319 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.139322 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.139333 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:40:46.139372 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.139374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.139412 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.139475 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:46.140262 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.140846 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.141631 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.141833 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.141905 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.144122 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:46.144125 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:46.144127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:46.144148 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:46.145605 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.146036 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.146038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.146039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.146110 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.146344 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.146346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.146347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.146501 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:46.146599 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.146788 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.146875 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:40:46.149659 19154 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:40:46.152638 19154 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:46.166608 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.160949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:39489 (local address 127.0.0.1:42572)
0923 14:40:46.161296 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.161333 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.161451 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.162144 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.162150 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.162176 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.162304 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.162311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.163490 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.163496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.165037 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.165047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.166087 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.166091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.166199 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.166236 (+ 37us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.166347 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.166458 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":93,"threads_started":1}
I20260923 14:40:46.166648 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.161133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42572 (local address 127.17.4.129:39489)
0923 14:40:46.161595 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.161604 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.161625 (+ 21us) server_negotiation.cc:407] Connection header received
0923 14:40:46.161701 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.161709 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.161930 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.162082 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.162442 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.163384 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.165184 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.165963 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.166074 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.166211 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.166391 (+ 180us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.166510 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":62,"threads_started":1}
I20260923 14:40:46.167209 19657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.161943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39489 (local address 127.0.0.1:58588)
0923 14:40:46.162346 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.162358 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.162422 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.163079 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.163082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.163103 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.163200 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.163207 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.164689 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.164692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.165753 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.165760 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.166790 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.166794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.166883 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.166907 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.166983 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.167068 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":88,"spinlock_wait_cycles":768,"thread_start_us":86,"threads_started":1}
I20260923 14:40:46.167594 19660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.162316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58588 (local address 127.17.4.130:39489)
0923 14:40:46.162688 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.162699 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.162718 (+ 19us) server_negotiation.cc:407] Connection header received
0923 14:40:46.162781 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.162785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.162939 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.163358 (+ 419us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.163488 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.164571 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.165865 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.166650 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.167178 (+ 528us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.167357 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.167407 (+ 50us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.167491 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":135,"threads_started":1}
I20260923 14:40:46.167686 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.161824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.17.4.131:41489)
0923 14:40:46.162153 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.162163 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.162551 (+ 388us) server_negotiation.cc:407] Connection header received
0923 14:40:46.162636 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.162641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.162832 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.162983 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.163180 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.164340 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.165647 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.166417 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.166514 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.166653 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.167456 (+ 803us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.167549 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":108,"threads_started":1}
I20260923 14:40:46.167110 19659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.161656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.0.0.1:34976)
0923 14:40:46.162310 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.162323 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.162413 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.162980 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.162983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.163001 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.163079 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.163084 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.164431 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.164433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.165525 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.165534 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.166721 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.166727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.166818 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.166838 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.166903 (+ 65us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.166974 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":22,"thread_start_us":85,"threads_started":1}
I20260923 14:40:46.169914 19432 tablet_service.cc:1467] Processing CreateTablet for tablet caf9ebaf59d447ef8a5a2458bcbd0e77 (DEFAULT_TABLE table=test-table [id=7cb0b971fa694d19a8f4d8e1795a3211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:46.169939 19292 tablet_service.cc:1467] Processing CreateTablet for tablet caf9ebaf59d447ef8a5a2458bcbd0e77 (DEFAULT_TABLE table=test-table [id=7cb0b971fa694d19a8f4d8e1795a3211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:46.170485 19572 tablet_service.cc:1467] Processing CreateTablet for tablet caf9ebaf59d447ef8a5a2458bcbd0e77 (DEFAULT_TABLE table=test-table [id=7cb0b971fa694d19a8f4d8e1795a3211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:46.170849 19432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf9ebaf59d447ef8a5a2458bcbd0e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.170922 19292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf9ebaf59d447ef8a5a2458bcbd0e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.171329 19572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf9ebaf59d447ef8a5a2458bcbd0e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.177925 19661 tablet_bootstrap.cc:492] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Bootstrap starting.
I20260923 14:40:46.178709 19662 tablet_bootstrap.cc:492] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Bootstrap starting.
I20260923 14:40:46.178709 19663 tablet_bootstrap.cc:492] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Bootstrap starting.
I20260923 14:40:46.180054 19661 tablet_bootstrap.cc:654] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.180779 19661 log.cc:824] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:46.180809 19662 tablet_bootstrap.cc:654] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.180804 19663 tablet_bootstrap.cc:654] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.181644 19662 log.cc:824] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:46.181644 19663 log.cc:824] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:46.182762 19661 tablet_bootstrap.cc:492] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: No bootstrap required, opened a new log
I20260923 14:40:46.182957 19661 ts_tablet_manager.cc:1397] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 14:40:46.183465 19662 tablet_bootstrap.cc:492] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: No bootstrap required, opened a new log
I20260923 14:40:46.183588 19663 tablet_bootstrap.cc:492] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: No bootstrap required, opened a new log
I20260923 14:40:46.183631 19662 ts_tablet_manager.cc:1397] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:40:46.183794 19663 ts_tablet_manager.cc:1397] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 14:40:46.186417 19663 raft_consensus.cc:348] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.186671 19663 raft_consensus.cc:374] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.186725 19663 raft_consensus.cc:729] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.186908 19661 raft_consensus.cc:348] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.187145 19661 raft_consensus.cc:374] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.187196 19661 raft_consensus.cc:729] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e922fd65d184083b9f86632f8194512, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.187196 19663 consensus_queue.cc:260] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.187609 19661 consensus_queue.cc:260] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.187935 19638 heartbeater.cc:503] Master 127.17.4.190:36827 was elected leader, sending a full tablet report...
I20260923 14:40:46.188024 19662 raft_consensus.cc:348] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.188223 19663 ts_tablet_manager.cc:1428] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260923 14:40:46.188232 19662 raft_consensus.cc:374] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.188275 19662 raft_consensus.cc:729] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.188540 19661 ts_tablet_manager.cc:1428] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 14:40:46.188865 19498 heartbeater.cc:503] Master 127.17.4.190:36827 was elected leader, sending a full tablet report...
I20260923 14:40:46.188650 19662 consensus_queue.cc:260] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.190469 19662 ts_tablet_manager.cc:1428] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260923 14:40:46.190472 19358 heartbeater.cc:503] Master 127.17.4.190:36827 was elected leader, sending a full tablet report...
W20260923 14:40:46.356153 19639 tablet.cc:2369] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:40:46.368361 19499 tablet.cc:2369] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:40:46.393213 19359 tablet.cc:2369] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:40:46.393985 19668 raft_consensus.cc:482] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:46.394168 19668 raft_consensus.cc:504] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.395234 19668 leader_election.cc:288] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489), e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:46.400051 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.395965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:53683 (local address 127.17.4.131:41489)
0923 14:40:46.396083 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.396088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.396155 (+ 67us) server_negotiation.cc:407] Connection header received
0923 14:40:46.396274 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.396276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.396314 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.396413 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.396631 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.397323 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.398755 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.399425 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.399540 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.399589 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.399895 (+ 306us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.399956 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:40:46.400178 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.395842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.17.4.130:53683)
0923 14:40:46.396093 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.396105 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.396194 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.396436 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.396438 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.396453 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.396531 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.396535 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.397406 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.397408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.398610 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.398621 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.399544 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.399548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.399731 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.399796 (+ 65us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.399874 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.400014 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":158,"spinlock_wait_cycles":9088,"thread_start_us":94,"threads_started":1}
I20260923 14:40:46.400178 19670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.395443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:39489 (local address 127.17.4.130:36163)
0923 14:40:46.395661 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.395675 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.395805 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.396093 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.396097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.396121 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.396268 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.396274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.397259 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.397261 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.398610 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.398621 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.399544 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.399548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.399728 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.399796 (+ 68us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.399874 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.400014 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":95,"thread_start_us":77,"threads_started":1}
I20260923 14:40:46.400496 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.395514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:36163 (local address 127.17.4.129:39489)
0923 14:40:46.395648 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.395657 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.395765 (+ 108us) server_negotiation.cc:407] Connection header received
0923 14:40:46.395904 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.395908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.395963 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.396042 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.396380 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.397161 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.398774 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.399424 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.399540 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.399589 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.400285 (+ 696us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.400385 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:40:46.400825 19592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf9ebaf59d447ef8a5a2458bcbd0e77" candidate_uuid: "6e922fd65d184083b9f86632f8194512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" is_pre_election: true
I20260923 14:40:46.401043 19312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf9ebaf59d447ef8a5a2458bcbd0e77" candidate_uuid: "6e922fd65d184083b9f86632f8194512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7857c2107e4829abb5b2c906a842b8" is_pre_election: true
I20260923 14:40:46.401119 19592 raft_consensus.cc:2454] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e922fd65d184083b9f86632f8194512 in term 0.
I20260923 14:40:46.401278 19312 raft_consensus.cc:2454] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e922fd65d184083b9f86632f8194512 in term 0.
I20260923 14:40:46.401587 19386 leader_election.cc:302] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e922fd65d184083b9f86632f8194512, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:46.401842 19668 raft_consensus.cc:2781] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:46.401927 19668 raft_consensus.cc:482] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:46.401971 19668 raft_consensus.cc:3037] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:46.403019 19668 raft_consensus.cc:504] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.403358 19668 leader_election.cc:288] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [CANDIDATE]: Term 1 election: Requested vote from peers 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489), e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:46.403684 19312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf9ebaf59d447ef8a5a2458bcbd0e77" candidate_uuid: "6e922fd65d184083b9f86632f8194512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7857c2107e4829abb5b2c906a842b8"
I20260923 14:40:46.403692 19592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf9ebaf59d447ef8a5a2458bcbd0e77" candidate_uuid: "6e922fd65d184083b9f86632f8194512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b59f93848741eeba4f1b9de6d02d3b"
I20260923 14:40:46.403842 19312 raft_consensus.cc:3037] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:46.403842 19592 raft_consensus.cc:3037] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:46.405164 19312 raft_consensus.cc:2454] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e922fd65d184083b9f86632f8194512 in term 1.
I20260923 14:40:46.405457 19386 leader_election.cc:302] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, 6e922fd65d184083b9f86632f8194512; no voters:
I20260923 14:40:46.405551 19592 raft_consensus.cc:2454] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e922fd65d184083b9f86632f8194512 in term 1.
I20260923 14:40:46.405632 19668 raft_consensus.cc:2781] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:46.405953 19668 raft_consensus.cc:686] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 1 LEADER]: Becoming Leader. State: Replica: 6e922fd65d184083b9f86632f8194512, State: Running, Role: LEADER
I20260923 14:40:46.406354 19668 consensus_queue.cc:237] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } }
I20260923 14:40:46.409308 19153 catalog_manager.cc:5495] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e922fd65d184083b9f86632f8194512 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "6e922fd65d184083b9f86632f8194512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } health_report { overall_health: HEALTHY } } }
Sep 23 14:40:46 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174445, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:46.481408 19204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.473817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55018 (local address 127.17.4.190:36827)
0923 14:40:46.473949 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.473952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.474176 (+ 224us) server_negotiation.cc:407] Connection header received
0923 14:40:46.474293 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.474295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.474335 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.474413 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:46.475018 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.475532 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.476275 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.476477 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.476552 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.478737 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:46.478740 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:46.478742 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:46.478760 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:46.479975 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.480367 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.480370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.480371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.480437 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:46.480677 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:46.480679 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:46.480680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:46.480848 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:46.480919 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.481166 (+ 247us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.481282 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":49}
I20260923 14:40:46.481419 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.473761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36827 (local address 127.0.0.1:55018)
0923 14:40:46.474078 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.474096 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.474206 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.474450 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.474452 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.474829 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:46.474920 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.474926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.475620 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.475622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.476173 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.476180 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.476571 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.476574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.476642 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.477243 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:46.477254 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:46.478623 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:46.480062 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:46.480070 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:46.480075 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:46.480281 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:46.480511 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:46.480513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:46.480515 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:46.480584 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:46.480933 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:46.480938 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:46.481027 (+ 89us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.481114 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.481223 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":136,"threads_started":1}
I20260923 14:40:46.485287 19153 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:55018:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 14:40:46.485917 19153 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:46.491070 19432 tablet_service.cc:1467] Processing CreateTablet for tablet 64c6176e641d4cafa48982a993e5b9d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2dc9d76fa5f2458dacb337821a3aad70]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:40:46.491178 19572 tablet_service.cc:1467] Processing CreateTablet for tablet 64c6176e641d4cafa48982a993e5b9d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2dc9d76fa5f2458dacb337821a3aad70]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:40:46.491873 19432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c6176e641d4cafa48982a993e5b9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.491914 19572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c6176e641d4cafa48982a993e5b9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.491927 19292 tablet_service.cc:1467] Processing CreateTablet for tablet 64c6176e641d4cafa48982a993e5b9d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2dc9d76fa5f2458dacb337821a3aad70]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:40:46.492754 19292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64c6176e641d4cafa48982a993e5b9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.494603 19661 tablet_bootstrap.cc:492] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: Bootstrap starting.
I20260923 14:40:46.494798 19663 tablet_bootstrap.cc:492] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: Bootstrap starting.
I20260923 14:40:46.495714 19662 tablet_bootstrap.cc:492] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: Bootstrap starting.
I20260923 14:40:46.495751 19663 tablet_bootstrap.cc:654] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.495850 19661 tablet_bootstrap.cc:654] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.496735 19662 tablet_bootstrap.cc:654] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.497197 19663 tablet_bootstrap.cc:492] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: No bootstrap required, opened a new log
I20260923 14:40:46.497236 19661 tablet_bootstrap.cc:492] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: No bootstrap required, opened a new log
I20260923 14:40:46.497311 19663 ts_tablet_manager.cc:1397] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260923 14:40:46.497350 19661 ts_tablet_manager.cc:1397] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260923 14:40:46.497814 19661 raft_consensus.cc:348] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.497859 19663 raft_consensus.cc:348] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.497936 19661 raft_consensus.cc:374] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.497962 19663 raft_consensus.cc:374] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.497979 19661 raft_consensus.cc:729] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e922fd65d184083b9f86632f8194512, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.497995 19663 raft_consensus.cc:729] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.498030 19662 tablet_bootstrap.cc:492] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: No bootstrap required, opened a new log
I20260923 14:40:46.498116 19662 ts_tablet_manager.cc:1397] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:46.498114 19663 consensus_queue.cc:260] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.498106 19661 consensus_queue.cc:260] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.498399 19667 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.498463 19661 ts_tablet_manager.cc:1428] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:40:46.498533 19667 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.498625 19662 raft_consensus.cc:348] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.498744 19662 raft_consensus.cc:374] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.498782 19662 raft_consensus.cc:729] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.498718 19668 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.498849 19668 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.498889 19662 consensus_queue.cc:260] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.499168 19662 ts_tablet_manager.cc:1428] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:46.499148 19669 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.499357 19669 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.500310 19663 ts_tablet_manager.cc:1428] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260923 14:40:46.647116 19353 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.17.4.129:39489
I20260923 14:40:46.685920 19667 raft_consensus.cc:482] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:46.686045 19667 raft_consensus.cc:504] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.687170 19667 leader_election.cc:288] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489), 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489)
I20260923 14:40:46.692209 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.687518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:49059 (local address 127.17.4.129:39489)
0923 14:40:46.687651 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.687655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.687810 (+ 155us) server_negotiation.cc:407] Connection header received
0923 14:40:46.687934 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.687937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.687993 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.688090 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.688423 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.689210 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.690917 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.691493 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.691612 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.691661 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.692009 (+ 348us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.692080 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:40:46.692212 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.687927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:50335 (local address 127.17.4.130:39489)
0923 14:40:46.688145 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.688159 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.688174 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:40:46.688239 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.688241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.688281 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.688370 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:46.688575 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.689284 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.690916 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.691493 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.691612 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.691661 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.692009 (+ 348us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.692081 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":59,"threads_started":1}
I20260923 14:40:46.692306 19683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.687453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:39489 (local address 127.17.4.131:49059)
0923 14:40:46.687663 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.687678 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.687824 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.688124 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.688130 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.688153 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.688291 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.688296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.689321 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.689324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.690795 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.690806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.691610 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.691614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.691826 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.691909 (+ 83us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.691983 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.692104 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":241,"thread_start_us":76,"threads_started":1}
I20260923 14:40:46.692466 19684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.687838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39489 (local address 127.17.4.131:50335)
0923 14:40:46.688085 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.688098 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.688162 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.688380 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.688385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.688404 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:46.688481 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.688484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.689378 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.689381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.690795 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.690806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.691610 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.691614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.691832 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.691904 (+ 72us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.691983 (+ 79us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.692103 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":167,"thread_start_us":56,"threads_started":1}
I20260923 14:40:46.692776 19312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c6176e641d4cafa48982a993e5b9d8" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7857c2107e4829abb5b2c906a842b8" is_pre_election: true
I20260923 14:40:46.692926 19312 raft_consensus.cc:2454] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 0.
I20260923 14:40:46.693101 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c6176e641d4cafa48982a993e5b9d8" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512" is_pre_election: true
I20260923 14:40:46.693325 19452 raft_consensus.cc:2454] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 0.
I20260923 14:40:46.693261 19526 leader_election.cc:302] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:46.693676 19667 raft_consensus.cc:2781] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:46.693771 19667 raft_consensus.cc:482] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:46.693823 19667 raft_consensus.cc:3037] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:46.694798 19667 raft_consensus.cc:504] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.695106 19667 leader_election.cc:288] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 election: Requested vote from peers 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489), 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489)
I20260923 14:40:46.695412 19312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c6176e641d4cafa48982a993e5b9d8" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7857c2107e4829abb5b2c906a842b8"
I20260923 14:40:46.695549 19312 raft_consensus.cc:3037] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:46.695523 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64c6176e641d4cafa48982a993e5b9d8" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512"
I20260923 14:40:46.695626 19452 raft_consensus.cc:3037] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:46.696482 19312 raft_consensus.cc:2454] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 1.
I20260923 14:40:46.696604 19452 raft_consensus.cc:2454] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 1.
I20260923 14:40:46.696776 19526 leader_election.cc:302] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:46.696933 19667 raft_consensus.cc:2781] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:46.697103 19667 raft_consensus.cc:686] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 LEADER]: Becoming Leader. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Running, Role: LEADER
I20260923 14:40:46.697414 19667 consensus_queue.cc:237] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.700135 19686 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: TxnStatusTablet state changed. Reason: New leader e5b59f93848741eeba4f1b9de6d02d3b. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.700297 19686 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:40:46.700569 19688 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 14:40:46.700779 19688 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 14:40:46.700652 19154 catalog_manager.cc:5495] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131). New cstate: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } health_report { overall_health: HEALTHY } } }
I20260923 14:40:46.734082 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.730128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34984 (local address 127.17.4.131:41489)
0923 14:40:46.730240 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.730244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.730257 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:40:46.730429 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.730433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.730493 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.730600 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:46.730909 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.731390 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.732631 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.732933 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.733011 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.733330 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.733702 (+ 372us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.733798 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.733937 (+ 139us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.733982 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260923 14:40:46.734208 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.730018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.0.0.1:34984)
0923 14:40:46.730155 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.730172 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.730275 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.730655 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.730658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.730667 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:46.730804 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.730810 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.731489 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.731493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.732463 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.732474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.733038 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.733042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.733131 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.733194 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.733814 (+ 620us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.733833 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.733921 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.734029 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260923 14:40:46.739100 19452 raft_consensus.cc:1261] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Refusing update from remote peer e5b59f93848741eeba4f1b9de6d02d3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:46.739219 19312 raft_consensus.cc:1261] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Refusing update from remote peer e5b59f93848741eeba4f1b9de6d02d3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:46.739724 19667 consensus_queue.cc:1035] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:46.740047 19686 consensus_queue.cc:1035] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:46.742937 19668 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: TxnStatusTablet state changed. Reason: New leader e5b59f93848741eeba4f1b9de6d02d3b. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.743057 19668 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.743337 19669 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: TxnStatusTablet state changed. Reason: New leader e5b59f93848741eeba4f1b9de6d02d3b. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.743453 19669 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.745458 19691 mvcc.cc:205] Tried to move back new op lower bound from 7332554533836673024 to 7332554533675098112. Current Snapshot: MvccSnapshot[applied={T|T < 7332554533836673024}]
I20260923 14:40:46.745949 19667 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.746054 19667 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:40:46.746447 19667 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.746562 19667 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P e5b59f93848741eeba4f1b9de6d02d3b: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:40:46.748191 19669 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.748296 19669 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P 5a7857c2107e4829abb5b2c906a842b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.748423 19693 mvcc.cc:205] Tried to move back new op lower bound from 7332554533836673024 to 7332554533675098112. Current Snapshot: MvccSnapshot[applied={T|T < 7332554533836673024}]
I20260923 14:40:46.748443 19668 tablet_replica.cc:439] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } } }
I20260923 14:40:46.748535 19668 tablet_replica.cc:442] T 64c6176e641d4cafa48982a993e5b9d8 P 6e922fd65d184083b9f86632f8194512: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:40:46.751181 19692 mvcc.cc:205] Tried to move back new op lower bound from 7332554533836673024 to 7332554533675098112. Current Snapshot: MvccSnapshot[applied={T|T < 7332554533836673024}]
I20260923 14:40:46.757236 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.752127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58592 (local address 127.17.4.130:39489)
0923 14:40:46.752240 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.752244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.753790 (+ 1546us) server_negotiation.cc:407] Connection header received
0923 14:40:46.753943 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.753946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.754005 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.754125 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:46.754378 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.754880 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.755748 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.756002 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.756112 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.756367 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.756785 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.756910 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.757046 (+ 136us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.757096 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:40:46.767963 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.764637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:56153 (local address 127.17.4.131:41489)
0923 14:40:46.764759 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.764764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.764912 (+ 148us) server_negotiation.cc:407] Connection header received
0923 14:40:46.765063 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.765066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.765134 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.765232 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:46.765481 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.765962 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.766867 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.767096 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.767213 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.767505 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.767578 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.767655 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.767775 (+ 120us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.767824 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:40:46.768007 19704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.764516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.17.4.130:56153)
0923 14:40:46.764824 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.764836 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.764954 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.765243 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.765246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.765253 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:46.765374 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.765379 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.766065 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.766071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.766737 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.766745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.767208 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.767212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.767311 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.767351 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.767670 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.767679 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.767747 (+ 68us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.767840 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":89,"threads_started":1}
I20260923 14:40:46.775154 19312 raft_consensus.cc:1261] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Refusing update from remote peer 6e922fd65d184083b9f86632f8194512: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:46.775295 19592 raft_consensus.cc:1261] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Refusing update from remote peer 6e922fd65d184083b9f86632f8194512: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:46.775676 19672 consensus_queue.cc:1035] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:46.775930 19668 consensus_queue.cc:1035] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:46.801067 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.796985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:44009 (local address 127.17.4.130:39489)
0923 14:40:46.797095 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:46.797100 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:46.797332 (+ 232us) server_negotiation.cc:407] Connection header received
0923 14:40:46.797432 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:46.797435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:46.797481 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:46.797562 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:46.798046 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.798821 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.799970 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.800292 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.800365 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.800702 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.800772 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.800828 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:46.800931 (+ 103us) server_negotiation.cc:299] Negotiation successful
0923 14:40:46.800970 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260923 14:40:46.801143 19708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:46.796929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39489 (local address 127.17.4.131:44009)
0923 14:40:46.797246 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:46.797259 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:46.797352 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:46.797788 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:46.797791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:46.797800 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:46.797925 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.797931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.798923 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.798926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.799834 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:46.799845 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:46.800469 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:46.800472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:46.800553 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:46.800596 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:46.800852 (+ 256us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:46.800858 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 14:40:46.800925 (+ 67us) client_negotiation.cc:240] Negotiation successful
0923 14:40:46.801000 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
I20260923 14:40:46.823659 19152 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:46.823881 19152 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:46.826553 19152 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Sending DeleteTablet for 3 replicas of tablet caf9ebaf59d447ef8a5a2458bcbd0e77
I20260923 14:40:46.827339 19432 tablet_service.cc:1514] Processing DeleteTablet for tablet caf9ebaf59d447ef8a5a2458bcbd0e77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:46 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58588
I20260923 14:40:46.827343 19292 tablet_service.cc:1514] Processing DeleteTablet for tablet caf9ebaf59d447ef8a5a2458bcbd0e77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:46 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:42572
I20260923 14:40:46.827967 19711 tablet_replica.cc:330] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: stopping tablet replica
I20260923 14:40:46.827981 19572 tablet_service.cc:1514] Processing DeleteTablet for tablet caf9ebaf59d447ef8a5a2458bcbd0e77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:46 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:34976
I20260923 14:40:46.828372 19711 raft_consensus.cc:2229] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:40:46.828763 19711 raft_consensus.cc:2258] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:46.829178 19152 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:40:46.829586 19152 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:46.830448 19711 ts_tablet_manager.cc:1905] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:46.830976 19712 tablet_replica.cc:330] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: stopping tablet replica
I20260923 14:40:46.831274 19712 raft_consensus.cc:2229] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:46.831471 19712 raft_consensus.cc:2258] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:46.831882 19713 tablet_replica.cc:330] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: stopping tablet replica
I20260923 14:40:46.832132 19713 raft_consensus.cc:2229] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:46.832283 19713 raft_consensus.cc:2258] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:46.834506 19712 ts_tablet_manager.cc:1905] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:46.835312 19292 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4687fe90a14428947a8393e9e25fa8 (DEFAULT_TABLE table=test-table [id=db4ae32f78574e509def828b3293fd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:46.835593 19292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4687fe90a14428947a8393e9e25fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.838312 19713 ts_tablet_manager.cc:1905] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:46.838336 19572 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4687fe90a14428947a8393e9e25fa8 (DEFAULT_TABLE table=test-table [id=db4ae32f78574e509def828b3293fd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:46.838680 19662 tablet_bootstrap.cc:492] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Bootstrap starting.
I20260923 14:40:46.839653 19662 tablet_bootstrap.cc:654] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.840128 19432 tablet_service.cc:1467] Processing CreateTablet for tablet 0a4687fe90a14428947a8393e9e25fa8 (DEFAULT_TABLE table=test-table [id=db4ae32f78574e509def828b3293fd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:46.840344 19712 ts_tablet_manager.cc:1918] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:46.840401 19432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4687fe90a14428947a8393e9e25fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.840731 19711 ts_tablet_manager.cc:1918] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:46.840848 19712 log.cc:1196] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/caf9ebaf59d447ef8a5a2458bcbd0e77
I20260923 14:40:46.841189 19712 ts_tablet_manager.cc:1939] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 5a7857c2107e4829abb5b2c906a842b8: Deleting consensus metadata
I20260923 14:40:46.841311 19711 log.cc:1196] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/caf9ebaf59d447ef8a5a2458bcbd0e77
I20260923 14:40:46.841442 19713 ts_tablet_manager.cc:1918] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:46.841535 19713 log.cc:1196] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/caf9ebaf59d447ef8a5a2458bcbd0e77
I20260923 14:40:46.841761 19711 ts_tablet_manager.cc:1939] T caf9ebaf59d447ef8a5a2458bcbd0e77 P 6e922fd65d184083b9f86632f8194512: Deleting consensus metadata
I20260923 14:40:46.842231 19713 ts_tablet_manager.cc:1939] T caf9ebaf59d447ef8a5a2458bcbd0e77 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting consensus metadata
I20260923 14:40:46.842648 19661 tablet_bootstrap.cc:492] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Bootstrap starting.
I20260923 14:40:46.843562 19661 tablet_bootstrap.cc:654] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.844628 19142 catalog_manager.cc:4841] TS 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489): tablet caf9ebaf59d447ef8a5a2458bcbd0e77 (table test-table [id=7cb0b971fa694d19a8f4d8e1795a3211]) successfully deleted
I20260923 14:40:46.844837 19142 catalog_manager.cc:4841] TS 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489): tablet caf9ebaf59d447ef8a5a2458bcbd0e77 (table test-table [id=7cb0b971fa694d19a8f4d8e1795a3211]) successfully deleted
I20260923 14:40:46.844920 19142 catalog_manager.cc:4841] TS e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489): tablet caf9ebaf59d447ef8a5a2458bcbd0e77 (table test-table [id=7cb0b971fa694d19a8f4d8e1795a3211]) successfully deleted
I20260923 14:40:46.844980 19661 tablet_bootstrap.cc:492] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: No bootstrap required, opened a new log
I20260923 14:40:46.845050 19661 ts_tablet_manager.cc:1397] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:40:46.845499 19661 raft_consensus.cc:348] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.845618 19661 raft_consensus.cc:374] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.845654 19661 raft_consensus.cc:729] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e922fd65d184083b9f86632f8194512, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.845657 19572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a4687fe90a14428947a8393e9e25fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:46.845777 19661 consensus_queue.cc:260] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.846032 19661 ts_tablet_manager.cc:1428] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:46.847859 19663 tablet_bootstrap.cc:492] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Bootstrap starting.
I20260923 14:40:46.848814 19663 tablet_bootstrap.cc:654] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:46.850224 19663 tablet_bootstrap.cc:492] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: No bootstrap required, opened a new log
I20260923 14:40:46.850308 19663 ts_tablet_manager.cc:1397] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 14:40:46.850426 19662 tablet_bootstrap.cc:492] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: No bootstrap required, opened a new log
I20260923 14:40:46.850502 19662 ts_tablet_manager.cc:1397] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260923 14:40:46.850734 19663 raft_consensus.cc:348] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.850845 19663 raft_consensus.cc:374] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.850876 19663 raft_consensus.cc:729] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.850924 19662 raft_consensus.cc:348] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.851037 19662 raft_consensus.cc:374] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:46.851007 19663 consensus_queue.cc:260] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.851066 19662 raft_consensus.cc:729] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Initialized, Role: FOLLOWER
I20260923 14:40:46.851181 19662 consensus_queue.cc:260] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:46.851264 19663 ts_tablet_manager.cc:1428] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:46.851428 19662 ts_tablet_manager.cc:1428] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260923 14:40:46.873484 19493 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.17.4.130:39489
I20260923 14:40:47.178325 19669 raft_consensus.cc:482] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:47.178474 19669 raft_consensus.cc:504] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:47.179494 19669 leader_election.cc:288] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489), e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:47.183403 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.179905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:44689 (local address 127.17.4.130:39489)
0923 14:40:47.180080 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:47.180088 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:47.180194 (+ 106us) server_negotiation.cc:407] Connection header received
0923 14:40:47.180346 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:47.180352 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:47.180405 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:47.180480 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:47.180776 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.181279 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.182415 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.182831 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.182988 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.183039 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:47.183215 (+ 176us) server_negotiation.cc:299] Negotiation successful
0923 14:40:47.183286 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 14:40:47.183420 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.179820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39489 (local address 127.17.4.129:44689)
0923 14:40:47.180071 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:47.180083 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:47.180230 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:47.180511 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:47.180513 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:47.180530 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:47.180657 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.180663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.181389 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.181395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.182299 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.182307 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.182987 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.182991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.183084 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.183113 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 14:40:47.183199 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:40:47.183264 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":6,"thread_start_us":66,"threads_started":1}
I20260923 14:40:47.183686 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.180317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:35947 (local address 127.17.4.131:41489)
0923 14:40:47.180442 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:47.180449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:47.180633 (+ 184us) server_negotiation.cc:407] Connection header received
0923 14:40:47.180784 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:47.180788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:47.180833 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:47.180920 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:40:47.181190 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.181664 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.182643 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.183109 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.183234 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.183294 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:47.183468 (+ 174us) server_negotiation.cc:299] Negotiation successful
0923 14:40:47.183559 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 14:40:47.183825 19718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.180218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.17.4.129:35947)
0923 14:40:47.180532 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:47.180543 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:47.180667 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:47.180929 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:47.180932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:47.180947 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:40:47.181078 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.181083 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.181798 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.181801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.182496 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.182504 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.183234 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.183237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.183336 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.183363 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 14:40:47.183450 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 14:40:47.183646 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":119,"threads_started":1}
I20260923 14:40:47.184283 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4687fe90a14428947a8393e9e25fa8" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512" is_pre_election: true
I20260923 14:40:47.184286 19592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4687fe90a14428947a8393e9e25fa8" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" is_pre_election: true
I20260923 14:40:47.184404 19592 raft_consensus.cc:2454] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 0.
I20260923 14:40:47.184435 19452 raft_consensus.cc:2454] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 0.
I20260923 14:40:47.184751 19246 leader_election.cc:302] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:47.184993 19669 raft_consensus.cc:2781] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:47.185040 19669 raft_consensus.cc:482] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:47.185065 19669 raft_consensus.cc:3037] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:47.185999 19669 raft_consensus.cc:504] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:47.186309 19669 leader_election.cc:288] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489), e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:47.186615 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4687fe90a14428947a8393e9e25fa8" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512"
I20260923 14:40:47.186707 19452 raft_consensus.cc:3037] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:47.186713 19592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a4687fe90a14428947a8393e9e25fa8" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b59f93848741eeba4f1b9de6d02d3b"
I20260923 14:40:47.186834 19592 raft_consensus.cc:3037] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:47.187603 19452 raft_consensus.cc:2454] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 1.
I20260923 14:40:47.187809 19592 raft_consensus.cc:2454] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 1.
I20260923 14:40:47.187870 19246 leader_election.cc:302] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, 6e922fd65d184083b9f86632f8194512; no voters:
I20260923 14:40:47.188031 19669 raft_consensus.cc:2781] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:47.188194 19669 raft_consensus.cc:686] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Running, Role: LEADER
I20260923 14:40:47.188416 19669 consensus_queue.cc:237] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:47.191104 19153 catalog_manager.cc:5495] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "5a7857c2107e4829abb5b2c906a842b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } health_report { overall_health: UNKNOWN } } }
I20260923 14:40:47.219523 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.216270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42582 (local address 127.17.4.129:39489)
0923 14:40:47.216457 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:47.216460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:47.216471 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:40:47.216529 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:47.216532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:47.216577 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:47.216685 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:47.216872 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.217377 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.218205 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.218432 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.218518 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.218743 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:47.219206 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:47.219293 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:47.219361 (+ 68us) server_negotiation.cc:299] Negotiation successful
0923 14:40:47.219406 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":72,"threads_started":1}
I20260923 14:40:47.228843 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.225877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53569 (local address 127.17.4.131:41489)
0923 14:40:47.225988 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:47.225991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:47.226097 (+ 106us) server_negotiation.cc:407] Connection header received
0923 14:40:47.226180 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:47.226182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:47.226231 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:47.226296 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:47.226566 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.227099 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.227951 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.228221 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.228304 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.228521 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:47.228580 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:47.228630 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:47.228703 (+ 73us) server_negotiation.cc:299] Negotiation successful
0923 14:40:47.228741 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 14:40:47.228871 19724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.225778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.17.4.129:53569)
0923 14:40:47.226027 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:47.226038 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:47.226119 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:47.226329 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:47.226331 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:47.226336 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:47.226424 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.226428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.227196 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.227199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.227856 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.227865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.228316 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.228318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.228381 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.228418 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:47.228647 (+ 229us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:47.228651 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:40:47.228697 (+ 46us) client_negotiation.cc:240] Negotiation successful
0923 14:40:47.228748 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260923 14:40:47.234494 19592 raft_consensus.cc:1261] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Refusing update from remote peer 5a7857c2107e4829abb5b2c906a842b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:47.234571 19452 raft_consensus.cc:1261] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Refusing update from remote peer 5a7857c2107e4829abb5b2c906a842b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:47.234942 19719 consensus_queue.cc:1035] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:47.235154 19669 consensus_queue.cc:1035] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:47.251412 19708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.248307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:39489 (local address 127.17.4.131:42825)
0923 14:40:47.248431 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:47.248446 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:47.248527 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:47.248728 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:47.248731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:47.248739 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:47.248851 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.248857 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.249618 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.249620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.250167 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:47.250175 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.250656 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.250660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:47.250734 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.250767 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:47.251115 (+ 348us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:47.251124 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 14:40:47.251213 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 14:40:47.251304 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260923 14:40:47.251405 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:47.248350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:42825 (local address 127.17.4.129:39489)
0923 14:40:47.248474 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:47.248478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:47.248492 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:40:47.248605 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:47.248607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:47.248643 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:47.248699 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:47.248936 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.249512 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.250267 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:47.250464 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:47.250534 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:47.250919 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:47.251010 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:47.251102 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:47.251225 (+ 123us) server_negotiation.cc:299] Negotiation successful
0923 14:40:47.251276 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260923 14:40:47.252172 19693 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 14:40:48.808305 19155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:48.808440 19155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:48.810711 19155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Sending DeleteTablet for 3 replicas of tablet 0a4687fe90a14428947a8393e9e25fa8
I20260923 14:40:48.811189 19292 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4687fe90a14428947a8393e9e25fa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:48 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:42572
I20260923 14:40:48.811300 19571 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4687fe90a14428947a8393e9e25fa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:48 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:34976
I20260923 14:40:48.811465 19432 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a4687fe90a14428947a8393e9e25fa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:48 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58588
I20260923 14:40:48.811549 19751 tablet_replica.cc:330] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: stopping tablet replica
I20260923 14:40:48.811692 19752 tablet_replica.cc:330] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: stopping tablet replica
I20260923 14:40:48.811692 19751 raft_consensus.cc:2229] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:40:48.811868 19752 raft_consensus.cc:2229] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:48.811957 19753 tablet_replica.cc:330] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: stopping tablet replica
I20260923 14:40:48.812000 19752 raft_consensus.cc:2258] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:48.811997 19751 raft_consensus.cc:2258] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:48.812172 19753 raft_consensus.cc:2229] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:48.812402 19753 raft_consensus.cc:2258] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:48.812680 19751 ts_tablet_manager.cc:1905] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:48.813109 19753 ts_tablet_manager.cc:1905] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:48.813148 19752 ts_tablet_manager.cc:1905] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:48.816020 19752 ts_tablet_manager.cc:1918] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 14:40:48.816164 19752 log.cc:1196] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/0a4687fe90a14428947a8393e9e25fa8
I20260923 14:40:48.816431 19753 ts_tablet_manager.cc:1918] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 14:40:48.816510 19752 ts_tablet_manager.cc:1939] T 0a4687fe90a14428947a8393e9e25fa8 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting consensus metadata
I20260923 14:40:48.816583 19753 log.cc:1196] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/0a4687fe90a14428947a8393e9e25fa8
I20260923 14:40:48.816941 19753 ts_tablet_manager.cc:1939] T 0a4687fe90a14428947a8393e9e25fa8 P 6e922fd65d184083b9f86632f8194512: Deleting consensus metadata
I20260923 14:40:48.817482 19751 ts_tablet_manager.cc:1918] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 14:40:48.817584 19751 log.cc:1196] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/0a4687fe90a14428947a8393e9e25fa8
I20260923 14:40:48.817775 19142 catalog_manager.cc:4841] TS e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489): tablet 0a4687fe90a14428947a8393e9e25fa8 (table test-table [id=db4ae32f78574e509def828b3293fd89]) successfully deleted
I20260923 14:40:48.817924 19142 catalog_manager.cc:4841] TS 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489): tablet 0a4687fe90a14428947a8393e9e25fa8 (table test-table [id=db4ae32f78574e509def828b3293fd89]) successfully deleted
I20260923 14:40:48.817979 19751 ts_tablet_manager.cc:1939] T 0a4687fe90a14428947a8393e9e25fa8 P 5a7857c2107e4829abb5b2c906a842b8: Deleting consensus metadata
I20260923 14:40:48.818678 19142 catalog_manager.cc:4841] TS 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489): tablet 0a4687fe90a14428947a8393e9e25fa8 (table test-table [id=db4ae32f78574e509def828b3293fd89]) successfully deleted
Sep 23 14:40:48 dist-test-slave-54kg krb5kdc[19110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 14:40:48 dist-test-slave-54kg krb5kdc[19110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:48.838114 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:48.829606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55034 (local address 127.17.4.190:36827)
0923 14:40:48.829914 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:48.829921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:48.829935 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:40:48.830082 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:48.830084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:48.830125 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:48.830233 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:48.830924 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:48.831573 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:48.832513 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:48.832755 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:48.832869 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:48.835160 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:48.835164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:48.835169 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:48.835196 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:48.836517 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:48.836914 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:48.836919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:48.836921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:48.837001 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:48.837259 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:48.837265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:48.837270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:48.837436 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:48.837573 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:48.837827 (+ 254us) server_negotiation.cc:299] Negotiation successful
0923 14:40:48.837948 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":133,"threads_started":1}
I20260923 14:40:48.840426 19155 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55034:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:40:48.840843 19155 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:48.845140 19432 tablet_service.cc:1467] Processing CreateTablet for tablet 7303aaef247f4df2aa58247991ef2324 (DEFAULT_TABLE table=test-table [id=bf21e086a09d4c5dad31165acefc449e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:48.845140 19292 tablet_service.cc:1467] Processing CreateTablet for tablet 7303aaef247f4df2aa58247991ef2324 (DEFAULT_TABLE table=test-table [id=bf21e086a09d4c5dad31165acefc449e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:48.845355 19571 tablet_service.cc:1467] Processing CreateTablet for tablet 7303aaef247f4df2aa58247991ef2324 (DEFAULT_TABLE table=test-table [id=bf21e086a09d4c5dad31165acefc449e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:48.845431 19432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7303aaef247f4df2aa58247991ef2324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:48.845431 19292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7303aaef247f4df2aa58247991ef2324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:48.845626 19571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7303aaef247f4df2aa58247991ef2324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:48.847911 19762 tablet_bootstrap.cc:492] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Bootstrap starting.
I20260923 14:40:48.848214 19764 tablet_bootstrap.cc:492] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Bootstrap starting.
I20260923 14:40:48.848704 19762 tablet_bootstrap.cc:654] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:48.848984 19764 tablet_bootstrap.cc:654] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:48.849545 19763 tablet_bootstrap.cc:492] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Bootstrap starting.
I20260923 14:40:48.849906 19762 tablet_bootstrap.cc:492] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: No bootstrap required, opened a new log
I20260923 14:40:48.850010 19764 tablet_bootstrap.cc:492] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: No bootstrap required, opened a new log
I20260923 14:40:48.850045 19762 ts_tablet_manager.cc:1397] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260923 14:40:48.850171 19764 ts_tablet_manager.cc:1397] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:48.850411 19763 tablet_bootstrap.cc:654] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:48.850485 19762 raft_consensus.cc:348] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.850620 19762 raft_consensus.cc:374] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:48.850684 19762 raft_consensus.cc:729] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Initialized, Role: FOLLOWER
I20260923 14:40:48.850661 19764 raft_consensus.cc:348] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.850792 19764 raft_consensus.cc:374] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:48.850836 19764 raft_consensus.cc:729] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Initialized, Role: FOLLOWER
I20260923 14:40:48.850848 19762 consensus_queue.cc:260] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.850970 19764 consensus_queue.cc:260] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.851305 19764 ts_tablet_manager.cc:1428] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:48.851534 19763 tablet_bootstrap.cc:492] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: No bootstrap required, opened a new log
I20260923 14:40:48.851595 19762 ts_tablet_manager.cc:1428] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:40:48.851617 19763 ts_tablet_manager.cc:1397] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:48.852028 19763 raft_consensus.cc:348] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.852169 19763 raft_consensus.cc:374] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:48.852200 19763 raft_consensus.cc:729] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e922fd65d184083b9f86632f8194512, State: Initialized, Role: FOLLOWER
I20260923 14:40:48.852309 19763 consensus_queue.cc:260] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.852667 19763 ts_tablet_manager.cc:1428] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:48.998963 19737 raft_consensus.cc:482] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:48.999083 19737 raft_consensus.cc:504] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:48.999508 19737 leader_election.cc:288] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489), 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489)
I20260923 14:40:48.999979 19311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7303aaef247f4df2aa58247991ef2324" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7857c2107e4829abb5b2c906a842b8" is_pre_election: true
I20260923 14:40:49.000041 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7303aaef247f4df2aa58247991ef2324" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512" is_pre_election: true
I20260923 14:40:49.000113 19311 raft_consensus.cc:2454] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 0.
I20260923 14:40:49.000260 19452 raft_consensus.cc:2454] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 0.
I20260923 14:40:49.000535 19526 leader_election.cc:302] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:49.000692 19737 raft_consensus.cc:2781] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:49.000748 19737 raft_consensus.cc:482] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:49.000787 19737 raft_consensus.cc:3037] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:49.001771 19737 raft_consensus.cc:504] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.002066 19737 leader_election.cc:288] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 election: Requested vote from peers 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489), 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489)
I20260923 14:40:49.002370 19311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7303aaef247f4df2aa58247991ef2324" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a7857c2107e4829abb5b2c906a842b8"
I20260923 14:40:49.002421 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7303aaef247f4df2aa58247991ef2324" candidate_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512"
I20260923 14:40:49.002511 19311 raft_consensus.cc:3037] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:49.002526 19452 raft_consensus.cc:3037] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:49.003440 19311 raft_consensus.cc:2454] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 1.
I20260923 14:40:49.003448 19452 raft_consensus.cc:2454] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5b59f93848741eeba4f1b9de6d02d3b in term 1.
I20260923 14:40:49.003710 19526 leader_election.cc:302] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:49.003911 19737 raft_consensus.cc:2781] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:49.004019 19737 raft_consensus.cc:686] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 LEADER]: Becoming Leader. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Running, Role: LEADER
I20260923 14:40:49.004166 19737 consensus_queue.cc:237] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.005710 19152 catalog_manager.cc:5495] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131). New cstate: current_term: 1 leader_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } health_report { overall_health: HEALTHY } } }
I20260923 14:40:49.043347 19771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:49.040511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.17.4.131:41489)
0923 14:40:49.040762 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:49.040771 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:49.040784 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:40:49.040819 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:49.040820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:49.040858 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:49.040969 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:49.041196 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.041683 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.042488 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.042702 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.042774 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:49.042997 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:49.043061 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:49.043112 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:49.043194 (+ 82us) server_negotiation.cc:299] Negotiation successful
0923 14:40:49.043233 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":124,"threads_started":1}
I20260923 14:40:49.051371 19771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:49.048730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:53093 (local address 127.17.4.131:41489)
0923 14:40:49.048832 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:49.048836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:49.048858 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:40:49.048956 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:49.048958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:49.048993 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:49.049050 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:49.049282 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.049730 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.050533 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.050756 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.050845 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:49.051031 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:49.051085 (+ 54us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:49.051136 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:49.051208 (+ 72us) server_negotiation.cc:299] Negotiation successful
0923 14:40:49.051245 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":43}
I20260923 14:40:49.051386 19774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:49.048566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:41489 (local address 127.17.4.131:53093)
0923 14:40:49.048798 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:49.048811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:49.048880 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:49.049071 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:49.049073 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:49.049078 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:40:49.049180 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:49.049184 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.049822 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.049824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:49.050426 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:49.050433 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.050861 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.050863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:49.050920 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:49.050941 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:40:49.051151 (+ 210us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:40:49.051156 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 14:40:49.051201 (+ 45us) client_negotiation.cc:240] Negotiation successful
0923 14:40:49.051260 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":14,"thread_start_us":94,"threads_started":1}
I20260923 14:40:49.056396 19452 raft_consensus.cc:1261] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Refusing update from remote peer e5b59f93848741eeba4f1b9de6d02d3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:49.056442 19311 raft_consensus.cc:1261] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Refusing update from remote peer e5b59f93848741eeba4f1b9de6d02d3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:49.056739 19732 consensus_queue.cc:1035] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:49.056902 19737 consensus_queue.cc:1035] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:49.087827 19152 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:49.087991 19152 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:49.089824 19152 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Sending DeleteTablet for 3 replicas of tablet 7303aaef247f4df2aa58247991ef2324
I20260923 14:40:49.090430 19571 tablet_service.cc:1514] Processing DeleteTablet for tablet 7303aaef247f4df2aa58247991ef2324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:49 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:34976
I20260923 14:40:49.090529 19292 tablet_service.cc:1514] Processing DeleteTablet for tablet 7303aaef247f4df2aa58247991ef2324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:49 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:42572
I20260923 14:40:49.090543 19432 tablet_service.cc:1514] Processing DeleteTablet for tablet 7303aaef247f4df2aa58247991ef2324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:49 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58588
I20260923 14:40:49.090596 19752 tablet_replica.cc:330] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: stopping tablet replica
I20260923 14:40:49.090677 19751 tablet_replica.cc:330] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: stopping tablet replica
I20260923 14:40:49.090709 19752 raft_consensus.cc:2229] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:40:49.090765 19751 raft_consensus.cc:2229] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:49.090855 19751 raft_consensus.cc:2258] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:49.090968 19752 raft_consensus.cc:2258] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:49.091022 19753 tablet_replica.cc:330] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: stopping tablet replica
I20260923 14:40:49.091125 19753 raft_consensus.cc:2229] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:49.091229 19753 raft_consensus.cc:2258] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:49.091858 19753 ts_tablet_manager.cc:1905] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:49.091858 19752 ts_tablet_manager.cc:1905] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:49.094358 19753 ts_tablet_manager.cc:1918] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:49.094440 19753 log.cc:1196] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/7303aaef247f4df2aa58247991ef2324
I20260923 14:40:49.094595 19751 ts_tablet_manager.cc:1905] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:49.094691 19753 ts_tablet_manager.cc:1939] T 7303aaef247f4df2aa58247991ef2324 P 6e922fd65d184083b9f86632f8194512: Deleting consensus metadata
I20260923 14:40:49.094969 19752 ts_tablet_manager.cc:1918] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:49.095086 19752 log.cc:1196] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/7303aaef247f4df2aa58247991ef2324
I20260923 14:40:49.095373 19752 ts_tablet_manager.cc:1939] T 7303aaef247f4df2aa58247991ef2324 P e5b59f93848741eeba4f1b9de6d02d3b: Deleting consensus metadata
I20260923 14:40:49.096000 19142 catalog_manager.cc:4841] TS e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489): tablet 7303aaef247f4df2aa58247991ef2324 (table test-table [id=bf21e086a09d4c5dad31165acefc449e]) successfully deleted
I20260923 14:40:49.096141 19142 catalog_manager.cc:4841] TS 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489): tablet 7303aaef247f4df2aa58247991ef2324 (table test-table [id=bf21e086a09d4c5dad31165acefc449e]) successfully deleted
I20260923 14:40:49.096442 19152 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55034:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:40:49.096819 19152 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:40:49.097077 19751 ts_tablet_manager.cc:1918] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:40:49.097146 19751 log.cc:1196] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/7303aaef247f4df2aa58247991ef2324
I20260923 14:40:49.097451 19751 ts_tablet_manager.cc:1939] T 7303aaef247f4df2aa58247991ef2324 P 5a7857c2107e4829abb5b2c906a842b8: Deleting consensus metadata
I20260923 14:40:49.098294 19142 catalog_manager.cc:4841] TS 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489): tablet 7303aaef247f4df2aa58247991ef2324 (table test-table [id=bf21e086a09d4c5dad31165acefc449e]) successfully deleted
I20260923 14:40:49.101174 19292 tablet_service.cc:1467] Processing CreateTablet for tablet 03264350e1cb44219c3ddeb5b58158ab (DEFAULT_TABLE table=test-table [id=62deba8d6439459bbd211fc636e2935f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:49.101380 19432 tablet_service.cc:1467] Processing CreateTablet for tablet 03264350e1cb44219c3ddeb5b58158ab (DEFAULT_TABLE table=test-table [id=62deba8d6439459bbd211fc636e2935f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:49.101437 19292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03264350e1cb44219c3ddeb5b58158ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:49.101590 19432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03264350e1cb44219c3ddeb5b58158ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:49.103562 19764 tablet_bootstrap.cc:492] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8: Bootstrap starting.
I20260923 14:40:49.103971 19571 tablet_service.cc:1467] Processing CreateTablet for tablet 03264350e1cb44219c3ddeb5b58158ab (DEFAULT_TABLE table=test-table [id=62deba8d6439459bbd211fc636e2935f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:40:49.104210 19571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03264350e1cb44219c3ddeb5b58158ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:49.104401 19764 tablet_bootstrap.cc:654] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:49.104892 19763 tablet_bootstrap.cc:492] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Bootstrap starting.
I20260923 14:40:49.105660 19763 tablet_bootstrap.cc:654] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:49.106225 19762 tablet_bootstrap.cc:492] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Bootstrap starting.
I20260923 14:40:49.106418 19764 tablet_bootstrap.cc:492] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8: No bootstrap required, opened a new log
I20260923 14:40:49.106494 19764 ts_tablet_manager.cc:1397] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260923 14:40:49.106844 19764 raft_consensus.cc:348] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.106953 19764 raft_consensus.cc:374] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:49.106982 19764 raft_consensus.cc:729] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Initialized, Role: FOLLOWER
I20260923 14:40:49.106997 19762 tablet_bootstrap.cc:654] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:49.107095 19764 consensus_queue.cc:260] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.107337 19764 ts_tablet_manager.cc:1428] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:40:49.108538 19763 tablet_bootstrap.cc:492] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: No bootstrap required, opened a new log
I20260923 14:40:49.108566 19762 tablet_bootstrap.cc:492] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: No bootstrap required, opened a new log
I20260923 14:40:49.108616 19763 ts_tablet_manager.cc:1397] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260923 14:40:49.108652 19762 ts_tablet_manager.cc:1397] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260923 14:40:49.109020 19763 raft_consensus.cc:348] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.109114 19763 raft_consensus.cc:374] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:49.109072 19762 raft_consensus.cc:348] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.109143 19763 raft_consensus.cc:729] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e922fd65d184083b9f86632f8194512, State: Initialized, Role: FOLLOWER
I20260923 14:40:49.109154 19762 raft_consensus.cc:374] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:49.109175 19762 raft_consensus.cc:729] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b59f93848741eeba4f1b9de6d02d3b, State: Initialized, Role: FOLLOWER
I20260923 14:40:49.109254 19763 consensus_queue.cc:260] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.109308 19762 consensus_queue.cc:260] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.109491 19763 ts_tablet_manager.cc:1428] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 14:40:49.109567 19762 ts_tablet_manager.cc:1428] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:40:49.305282 19742 raft_consensus.cc:482] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:40:49.305459 19742 raft_consensus.cc:504] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.305886 19742 leader_election.cc:288] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489), e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:49.306332 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03264350e1cb44219c3ddeb5b58158ab" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512" is_pre_election: true
I20260923 14:40:49.306368 19592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03264350e1cb44219c3ddeb5b58158ab" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" is_pre_election: true
I20260923 14:40:49.306496 19592 raft_consensus.cc:2454] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 0.
I20260923 14:40:49.306497 19452 raft_consensus.cc:2454] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 0.
I20260923 14:40:49.306849 19246 leader_election.cc:302] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:49.307021 19742 raft_consensus.cc:2781] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:40:49.307080 19742 raft_consensus.cc:482] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:40:49.307118 19742 raft_consensus.cc:3037] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:49.308359 19742 raft_consensus.cc:504] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.308665 19742 leader_election.cc:288] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489), e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489)
I20260923 14:40:49.309026 19452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03264350e1cb44219c3ddeb5b58158ab" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e922fd65d184083b9f86632f8194512"
I20260923 14:40:49.309082 19592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03264350e1cb44219c3ddeb5b58158ab" candidate_uuid: "5a7857c2107e4829abb5b2c906a842b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b59f93848741eeba4f1b9de6d02d3b"
I20260923 14:40:49.309155 19452 raft_consensus.cc:3037] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:49.309185 19592 raft_consensus.cc:3037] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:49.310511 19452 raft_consensus.cc:2454] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 1.
I20260923 14:40:49.310531 19592 raft_consensus.cc:2454] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7857c2107e4829abb5b2c906a842b8 in term 1.
I20260923 14:40:49.310911 19246 leader_election.cc:302] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a7857c2107e4829abb5b2c906a842b8, e5b59f93848741eeba4f1b9de6d02d3b; no voters:
I20260923 14:40:49.312043 19742 raft_consensus.cc:2781] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:49.312234 19742 raft_consensus.cc:686] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7857c2107e4829abb5b2c906a842b8, State: Running, Role: LEADER
I20260923 14:40:49.312402 19742 consensus_queue.cc:237] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } }
I20260923 14:40:49.314057 19152 catalog_manager.cc:5495] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "5a7857c2107e4829abb5b2c906a842b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a7857c2107e4829abb5b2c906a842b8" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 39489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 } health_report { overall_health: UNKNOWN } } }
I20260923 14:40:49.347886 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:49.344912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42586 (local address 127.17.4.129:39489)
0923 14:40:49.345113 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:49.345126 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:49.345138 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:40:49.345180 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:49.345182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:49.345218 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:49.345297 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:40:49.345457 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.345958 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.346752 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:49.346971 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:49.347046 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:49.347418 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:40:49.347492 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:40:49.347546 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:49.347662 (+ 116us) server_negotiation.cc:299] Negotiation successful
0923 14:40:49.347702 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
I20260923 14:40:49.353062 19592 raft_consensus.cc:1261] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Refusing update from remote peer 5a7857c2107e4829abb5b2c906a842b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:49.353452 19451 raft_consensus.cc:1261] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Refusing update from remote peer 5a7857c2107e4829abb5b2c906a842b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:40:49.353837 19781 consensus_queue.cc:1035] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5b59f93848741eeba4f1b9de6d02d3b" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 41489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:40:49.354010 19742 consensus_queue.cc:1035] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e922fd65d184083b9f86632f8194512" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 14:40:49.366436 19734 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 14:40:50.912918 19155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:50.913056 19155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:40:50.915122 19155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10c02bff22cb42529ad1efe2d1589974: Sending DeleteTablet for 3 replicas of tablet 03264350e1cb44219c3ddeb5b58158ab
I20260923 14:40:50.915552 19292 tablet_service.cc:1514] Processing DeleteTablet for tablet 03264350e1cb44219c3ddeb5b58158ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:50 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:42572
I20260923 14:40:50.915673 19571 tablet_service.cc:1514] Processing DeleteTablet for tablet 03264350e1cb44219c3ddeb5b58158ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:50 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:34976
I20260923 14:40:50.915872 19432 tablet_service.cc:1514] Processing DeleteTablet for tablet 03264350e1cb44219c3ddeb5b58158ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:40:50 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58588
I20260923 14:40:50.915897 19809 tablet_replica.cc:330] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8: stopping tablet replica
I20260923 14:40:50.916062 19809 raft_consensus.cc:2229] T 03264350e1cb44219c3ddeb5b58158ab P 5a7857c2107e4829abb5b2c906a842b8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:40:50.916090 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 19227
I20260923 14:40:50.916153 19810 tablet_replica.cc:330] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: stopping tablet replica
I20260923 14:40:50.917182 19810 raft_consensus.cc:2229] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:50.917320 19810 raft_consensus.cc:2258] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:50.917631 19811 tablet_replica.cc:330] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: stopping tablet replica
I20260923 14:40:50.917805 19811 raft_consensus.cc:2229] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:40:50.917924 19811 raft_consensus.cc:2258] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:40:50.917975 19810 ts_tablet_manager.cc:1905] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:50.918459 19811 ts_tablet_manager.cc:1905] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:40:50.920671 19810 ts_tablet_manager.cc:1918] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 14:40:50.920745 19810 log.cc:1196] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/03264350e1cb44219c3ddeb5b58158ab
I20260923 14:40:50.921006 19811 ts_tablet_manager.cc:1918] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 14:40:50.921088 19810 ts_tablet_manager.cc:1939] T 03264350e1cb44219c3ddeb5b58158ab P e5b59f93848741eeba4f1b9de6d02d3b: Deleting consensus metadata
I20260923 14:40:50.921100 19811 log.cc:1196] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/03264350e1cb44219c3ddeb5b58158ab
I20260923 14:40:50.921388 19811 ts_tablet_manager.cc:1939] T 03264350e1cb44219c3ddeb5b58158ab P 6e922fd65d184083b9f86632f8194512: Deleting consensus metadata
I20260923 14:40:50.921797 19142 catalog_manager.cc:4841] TS e5b59f93848741eeba4f1b9de6d02d3b (127.17.4.131:41489): tablet 03264350e1cb44219c3ddeb5b58158ab (table test-table [id=62deba8d6439459bbd211fc636e2935f]) successfully deleted
I20260923 14:40:50.921981 19142 catalog_manager.cc:4841] TS 6e922fd65d184083b9f86632f8194512 (127.17.4.130:39489): tablet 03264350e1cb44219c3ddeb5b58158ab (table test-table [id=62deba8d6439459bbd211fc636e2935f]) successfully deleted
W20260923 14:40:50.924002 19142 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:39489 (error 108)
I20260923 14:40:50.924124 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 19367
I20260923 14:40:50.925774 19813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:50.925421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:39489 (local address 127.0.0.1:42594)
0923 14:40:50.925638 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:50.925700 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:39489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
W20260923 14:40:50.925897 19142 catalog_manager.cc:4584] TS 5a7857c2107e4829abb5b2c906a842b8 (127.17.4.129:39489): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03264350e1cb44219c3ddeb5b58158ab: Network error: Client connection negotiation failed: client connection to 127.17.4.129:39489: connect: Connection refused (error 111)
I20260923 14:40:50.931361 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 19507
I20260923 14:40:50.939688 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 19123
2026-09-23T14:40:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6879 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:50 dist-test-slave-54kg krb5kdc[19816](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:50 dist-test-slave-54kg krb5kdc[19816](info): set up 2 sockets
Sep 23 14:40:50 dist-test-slave-54kg krb5kdc[19816](info): commencing operation
krb5kdc: starting...
W20260923 14:40:51.960819 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.999s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:52.076702 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:40343
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:40343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:52.182101 19829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:52.182322 19829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:52.182358 19829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:52.186184 19829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:52.186235 19829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:52.186254 19829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:52.186321 19829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:52.186350 19829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:52.191059 19829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:40343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:40343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:52.191967 19829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:52.192864 19829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:52.200860 19837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.200953 19829 server_base.cc:1034] running on GCE node
W20260923 14:40:52.200882 19834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:52.200894 19835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.201596 19829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:52.202518 19829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:52.203694 19829 hybrid_clock.cc:648] HybridClock initialized: now 1790174452203679 us; error 33 us; skew 500 ppm
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:52.213342 19829 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:52.214112 19829 webserver.cc:460] Webserver started at http://127.17.4.190:40205/ using document root <none> and password file <none>
I20260923 14:40:52.214633 19829 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:52.214720 19829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:52.214929 19829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:52.216846 19829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "c3eef1014b4a4b2f81a5e642dd7849cf"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "b42bf0376fbbc1849efad0e9471fdf8d"
server_key_iv: "72cc340955796b961fd2f11d2f461d81"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.217360 19829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "c3eef1014b4a4b2f81a5e642dd7849cf"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "b42bf0376fbbc1849efad0e9471fdf8d"
server_key_iv: "72cc340955796b961fd2f11d2f461d81"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.220750 19829 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:52.222831 19844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.223977 19829 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:52.224104 19829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "c3eef1014b4a4b2f81a5e642dd7849cf"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "b42bf0376fbbc1849efad0e9471fdf8d"
server_key_iv: "72cc340955796b961fd2f11d2f461d81"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.224233 19829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:52.232836 19829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:52.235860 19829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:52.236037 19829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:52.242622 19829 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:40343
I20260923 14:40:52.242636 19896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:40343 every 8 connection(s)
I20260923 14:40:52.243497 19829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:52.245932 19897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:52.250782 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf: Bootstrap starting.
I20260923 14:40:52.252172 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 19829
I20260923 14:40:52.252310 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:52.252542 17426 external_mini_cluster.cc:1428] Setting key 9e01da1d4591ebaeb4d0fac36d35f5a7
I20260923 14:40:52.253201 19897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:52.254024 19897 log.cc:824] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:52.255654 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf: No bootstrap required, opened a new log
I20260923 14:40:52.258782 19897 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40343 } }
I20260923 14:40:52.259043 19897 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:52.259132 19897 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3eef1014b4a4b2f81a5e642dd7849cf, State: Initialized, Role: FOLLOWER
I20260923 14:40:52.259608 19897 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40343 } }
I20260923 14:40:52.259727 19897 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:52.259827 19897 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:52.259929 19897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 0 FOLLOWER]: Advancing to term 1
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:52.260988 19897 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40343 } }
I20260923 14:40:52.261348 19897 leader_election.cc:302] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3eef1014b4a4b2f81a5e642dd7849cf; no voters:
I20260923 14:40:52.261696 19897 leader_election.cc:288] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:52.261821 19902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:52.262077 19902 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [term 1 LEADER]: Becoming Leader. State: Replica: c3eef1014b4a4b2f81a5e642dd7849cf, State: Running, Role: LEADER
I20260923 14:40:52.262425 19902 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40343 } }
I20260923 14:40:52.262928 19897 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:52.264124 19903 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3eef1014b4a4b2f81a5e642dd7849cf. Latest consensus state: current_term: 1 leader_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40343 } } }
I20260923 14:40:52.264243 19903 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:52.264536 19904 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3eef1014b4a4b2f81a5e642dd7849cf" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40343 } } }
I20260923 14:40:52.264642 19904 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:52.266783 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.253586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50212 (local address 127.17.4.190:40343)
0923 14:40:52.253958 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:52.253971 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:52.254003 (+ 32us) server_negotiation.cc:407] Connection header received
0923 14:40:52.254798 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:52.254815 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:52.255086 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:52.255383 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:52.256177 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.257108 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.257984 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.258440 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.258605 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.261377 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:52.261382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:52.261393 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:52.261416 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:52.263518 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.264184 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.264189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.264195 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.264346 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.264788 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.264791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.264793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.265282 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:52.265507 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:52.265856 (+ 349us) server_negotiation.cc:299] Negotiation successful
0923 14:40:52.266111 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":116,"threads_started":1}
W20260923 14:40:52.267956 19917 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:40:52.268028 19917 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:40:52.268085 19912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:52.268872 19912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:52.273574 19912 catalog_manager.cc:1347] Generated new cluster ID: cda926d6030a40ce99b0b8f5819159ef
I20260923 14:40:52.273633 19912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:52.283608 19912 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:52.284518 19912 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:52.288511 19912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3eef1014b4a4b2f81a5e642dd7849cf: Generated new TSK 0
I20260923 14:40:52.289034 19912 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:52.319336 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40343
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:52.425187 19923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:52.425416 19923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:52.425479 19923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:52.429476 19923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:52.429522 19923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:52.429622 19923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:52.434590 19923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:52.435510 19923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:52.436429 19923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:52.445251 19928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:52.445257 19931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.445464 19923 server_base.cc:1034] running on GCE node
W20260923 14:40:52.445608 19929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.445984 19923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:52.446512 19923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:52.447686 19923 hybrid_clock.cc:648] HybridClock initialized: now 1790174452447668 us; error 29 us; skew 500 ppm
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:52.450135 19923 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:52.450946 19923 webserver.cc:460] Webserver started at http://127.17.4.129:42497/ using document root <none> and password file <none>
I20260923 14:40:52.451421 19923 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:52.451505 19923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:52.451705 19923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:52.453488 19923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "9bced828e1534fbfa288ba26fd6d178b"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "37f78689a8206ba533d1fa557cb8401c"
server_key_iv: "8f3d63a5819fa81d2606b0763a433977"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.454012 19923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "9bced828e1534fbfa288ba26fd6d178b"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "37f78689a8206ba533d1fa557cb8401c"
server_key_iv: "8f3d63a5819fa81d2606b0763a433977"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.457381 19923 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 14:40:52.459741 19938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.460912 19923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:52.460996 19923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "9bced828e1534fbfa288ba26fd6d178b"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "37f78689a8206ba533d1fa557cb8401c"
server_key_iv: "8f3d63a5819fa81d2606b0763a433977"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.461063 19923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:52.492602 19923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:52.495297 19923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:52.495436 19923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:52.495946 19923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:52.496657 19923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:52.496699 19923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.496744 19923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:52.496766 19923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.504914 19923 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:45991
I20260923 14:40:52.504962 20051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:45991 every 8 connection(s)
I20260923 14:40:52.505870 19923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:52.514966 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 19923
I20260923 14:40:52.515084 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:52.515424 17426 external_mini_cluster.cc:1428] Setting key 1dddaca3820a418f19fbd07f56926a36
I20260923 14:40:52.519577 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.507565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:51709 (local address 127.17.4.190:40343)
0923 14:40:52.507686 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:52.507689 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:52.508671 (+ 982us) server_negotiation.cc:407] Connection header received
0923 14:40:52.509521 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:52.509524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:52.509582 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:52.509681 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:52.510763 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.511283 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.512391 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.512625 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.512732 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.514999 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:52.515002 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:52.515004 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:52.515028 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:52.517118 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.517733 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.517738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.517742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.517837 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.518250 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.518257 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.518262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.518535 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:52.518645 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:52.519287 (+ 642us) server_negotiation.cc:299] Negotiation successful
0923 14:40:52.519416 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:40:52.520592 20054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.507933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40343 (local address 127.17.4.129:51709)
0923 14:40:52.508523 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:52.508559 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:52.509321 (+ 762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:52.509856 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:52.509863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:52.510179 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:52.510604 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:52.510616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.511407 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.511411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:52.512263 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:52.512272 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.512785 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.512789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:52.512941 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.513442 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:52.513457 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:52.514828 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:52.517266 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:52.517273 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:52.517287 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:52.517606 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:52.517961 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:52.517964 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:52.517966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:52.518136 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:52.518661 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:52.518666 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:52.519022 (+ 356us) client_negotiation.cc:769] Sending connection context
0923 14:40:52.519236 (+ 214us) client_negotiation.cc:240] Negotiation successful
0923 14:40:52.519575 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":96,"threads_started":1}
I20260923 14:40:52.521731 20052 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40343
I20260923 14:40:52.521997 20052 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:52.522593 20052 heartbeater.cc:511] Master 127.17.4.190:40343 requested a full tablet report, sending...
I20260923 14:40:52.524133 19861 ts_manager.cc:194] Registered new tserver with Master: 9bced828e1534fbfa288ba26fd6d178b (127.17.4.129:45991)
I20260923 14:40:52.525190 19861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:51709
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:52.543191 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40343
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:52.647303 20057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:52.647518 20057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:52.647555 20057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:52.651248 20057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:52.651290 20057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:52.651362 20057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:52.656220 20057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:52.657159 20057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:52.658103 20057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:52.667294 20065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:52.667301 20063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.667435 20057 server_base.cc:1034] running on GCE node
W20260923 14:40:52.667301 20062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.667923 20057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:52.668497 20057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:52.669669 20057 hybrid_clock.cc:648] HybridClock initialized: now 1790174452669636 us; error 44 us; skew 500 ppm
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:52.672185 20057 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:52.672996 20057 webserver.cc:460] Webserver started at http://127.17.4.130:40071/ using document root <none> and password file <none>
I20260923 14:40:52.673539 20057 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:52.673628 20057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:52.673830 20057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:52.675730 20057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "1a7ad7740575454296165a04dbee8c84"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "b4b13abfa155c152fa573b6b0355b8ae"
server_key_iv: "4ef029f43ac51188ea2a724cc65cb2fd"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.676386 20057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "1a7ad7740575454296165a04dbee8c84"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "b4b13abfa155c152fa573b6b0355b8ae"
server_key_iv: "4ef029f43ac51188ea2a724cc65cb2fd"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.679831 20057 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:52.682094 20072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.683205 20057 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:52.683347 20057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "1a7ad7740575454296165a04dbee8c84"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "b4b13abfa155c152fa573b6b0355b8ae"
server_key_iv: "4ef029f43ac51188ea2a724cc65cb2fd"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.683454 20057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:52.698014 20057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:52.700698 20057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:52.700891 20057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:52.701443 20057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:52.702241 20057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:52.702313 20057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.702389 20057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:52.702438 20057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.710978 20057 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:38521
I20260923 14:40:52.711001 20185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:38521 every 8 connection(s)
I20260923 14:40:52.711735 20057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:52.718930 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20057
I20260923 14:40:52.719064 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:52.719350 17426 external_mini_cluster.cc:1428] Setting key 9e9b10958b7feb78d07d1141297f9284
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:52.724161 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.713358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:46623 (local address 127.17.4.190:40343)
0923 14:40:52.713492 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:52.713496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:52.714241 (+ 745us) server_negotiation.cc:407] Connection header received
0923 14:40:52.715397 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:52.715399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:52.715445 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:52.715515 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:52.716540 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.717030 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.718056 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.718264 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.718360 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.720734 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:52.720743 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:52.720745 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:52.720767 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:52.722135 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.722699 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.722703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.722705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.722781 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.723113 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.723119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.723124 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.723297 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:52.723397 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:52.723885 (+ 488us) server_negotiation.cc:299] Negotiation successful
0923 14:40:52.723995 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:40:52.724884 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.713703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40343 (local address 127.17.4.130:46623)
0923 14:40:52.714103 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:52.714140 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:52.715189 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:52.715666 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:52.715672 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:52.715996 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:52.716428 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:52.716440 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.717126 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.717128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:52.717957 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:52.717965 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.718414 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.718417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:52.718543 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.719127 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:52.719148 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:52.720579 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:52.722265 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:52.722271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:52.722283 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:52.722603 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:52.722870 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:52.722874 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:52.722876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:52.723005 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:52.723408 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:52.723415 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:52.723630 (+ 215us) client_negotiation.cc:769] Sending connection context
0923 14:40:52.723831 (+ 201us) client_negotiation.cc:240] Negotiation successful
0923 14:40:52.724132 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":103,"threads_started":1}
I20260923 14:40:52.725939 20186 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40343
I20260923 14:40:52.726182 20186 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:52.726661 20186 heartbeater.cc:511] Master 127.17.4.190:40343 requested a full tablet report, sending...
I20260923 14:40:52.727782 19861 ts_manager.cc:194] Registered new tserver with Master: 1a7ad7740575454296165a04dbee8c84 (127.17.4.130:38521)
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:40:52.728502 19861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:46623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:52.744618 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40343
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:52.851292 20191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:52.851507 20191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:52.851544 20191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:52.855274 20191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:52.855322 20191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:52.855391 20191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:52.860348 20191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:52.861274 20191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:52.862200 20191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:40:52.871661 20191 server_base.cc:1034] running on GCE node
W20260923 14:40:52.871595 20199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:52.871580 20196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:52.871605 20197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:52.872224 20191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:52.872834 20191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:52.873986 20191 hybrid_clock.cc:648] HybridClock initialized: now 1790174452873976 us; error 26 us; skew 500 ppm
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:52.876595 20191 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:52.877436 20191 webserver.cc:460] Webserver started at http://127.17.4.131:41847/ using document root <none> and password file <none>
I20260923 14:40:52.877995 20191 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:52.878053 20191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:52.878306 20191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:52.880350 20191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "ffb9c2859cb64afb91652b0c70bb5e17"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "dca8bfa280b87aba1594c1c9b1040564"
server_key_iv: "b5a47675318961d352fc4daff9a7075a"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.880885 20191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "ffb9c2859cb64afb91652b0c70bb5e17"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "dca8bfa280b87aba1594c1c9b1040564"
server_key_iv: "b5a47675318961d352fc4daff9a7075a"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.884310 20191 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260923 14:40:52.886581 20206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.887719 20191 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:52.887884 20191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "ffb9c2859cb64afb91652b0c70bb5e17"
format_stamp: "Formatted at 2026-09-23 14:40:52 on dist-test-slave-54kg"
server_key: "dca8bfa280b87aba1594c1c9b1040564"
server_key_iv: "b5a47675318961d352fc4daff9a7075a"
server_key_version: "encryptionkey@0"
I20260923 14:40:52.887966 20191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:52.898370 20191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:52.900976 20191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:52.901150 20191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:52.901638 20191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:52.902343 20191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:52.902382 20191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.902441 20191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:52.902477 20191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:52.911263 20191 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:38987
I20260923 14:40:52.911283 20319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:38987 every 8 connection(s)
I20260923 14:40:52.912065 20191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:52.919948 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20191
I20260923 14:40:52.920032 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
Sep 23 14:40:52 dist-test-slave-54kg krb5kdc[19816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:52.920292 17426 external_mini_cluster.cc:1428] Setting key f6829588aa9250903fbeebe39b2e2f4e
I20260923 14:40:52.924431 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.913650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:48347 (local address 127.17.4.190:40343)
0923 14:40:52.913783 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:52.913787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:52.914636 (+ 849us) server_negotiation.cc:407] Connection header received
0923 14:40:52.915390 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:52.915392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:52.915437 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:52.915505 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:52.916576 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.917115 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.918136 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.918332 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.918401 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.920844 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:52.920847 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:52.920849 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:52.920891 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:52.922440 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.923003 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.923006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.923007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.923095 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:52.923542 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:52.923544 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:52.923546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:52.923711 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:52.923841 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:52.924235 (+ 394us) server_negotiation.cc:299] Negotiation successful
0923 14:40:52.924322 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:40:52.925165 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:52.913909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40343 (local address 127.17.4.131:48347)
0923 14:40:52.914504 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:52.914537 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:52.915222 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:52.915685 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:52.915691 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:52.916025 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:52.916452 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:52.916463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.917213 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.917215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:52.918033 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:52.918042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:52.918446 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:52.918448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:52.918592 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:52.919155 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:52.919170 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:52.920658 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:52.922574 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:52.922579 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:52.922592 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:52.922912 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:52.923222 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:52.923227 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:52.923229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:52.923446 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:52.923834 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:52.923847 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:52.924037 (+ 190us) client_negotiation.cc:769] Sending connection context
0923 14:40:52.924181 (+ 144us) client_negotiation.cc:240] Negotiation successful
0923 14:40:52.924405 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":99,"threads_started":1}
I20260923 14:40:52.926105 20320 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40343
I20260923 14:40:52.926333 20320 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:52.926755 20320 heartbeater.cc:511] Master 127.17.4.190:40343 requested a full tablet report, sending...
I20260923 14:40:52.927704 19861 ts_manager.cc:194] Registered new tserver with Master: ffb9c2859cb64afb91652b0c70bb5e17 (127.17.4.131:38987)
I20260923 14:40:52.928200 19861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:48347
I20260923 14:40:52.934815 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 14:40:52.946945 19900 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:40:52.945625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50214 (local address 127.17.4.190:40343)
0923 14:40:52.945780 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:52.945785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:52.945922 (+ 137us) server_negotiation.cc:407] Connection header received
0923 14:40:52.946070 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:52.946073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:52.946118 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:52.946200 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:52.946852 (+ 652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50214: BlockingRecv error: recv got EOF from 127.0.0.1:50214 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 14:40:52.947964 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 19923
I20260923 14:40:52.952939 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20057
I20260923 14:40:52.958382 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20191
I20260923 14:40:52.963178 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 19829
2026-09-23T14:40:52Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2021 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:53 dist-test-slave-54kg krb5kdc[20332](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:53 dist-test-slave-54kg krb5kdc[20332](info): set up 2 sockets
Sep 23 14:40:53 dist-test-slave-54kg krb5kdc[20332](info): commencing operation
krb5kdc: starting...
W20260923 14:40:53.976756 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.992s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:54 dist-test-slave-54kg krb5kdc[20332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:54.092221 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:38253
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:38253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:54.195564 20345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:54.195842 20345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:54.195940 20345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:54.199838 20345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:54.199911 20345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:54.199950 20345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:54.199999 20345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:54.200034 20345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:54.204855 20345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:38253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:38253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:54.205726 20345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:54.206616 20345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:54.214399 20351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:54.214426 20350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:54.214476 20345 server_base.cc:1034] running on GCE node
W20260923 14:40:54.214429 20353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:54.215106 20345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:54.216092 20345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:54.217252 20345 hybrid_clock.cc:648] HybridClock initialized: now 1790174454217227 us; error 37 us; skew 500 ppm
Sep 23 14:40:54 dist-test-slave-54kg krb5kdc[20332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174454, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:54.219755 20345 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:54.220613 20345 webserver.cc:460] Webserver started at http://127.17.4.190:38127/ using document root <none> and password file <none>
I20260923 14:40:54.221082 20345 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:54.221136 20345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:54.221310 20345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:54.223054 20345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "e69e380308814de4b950e5182c34c136"
format_stamp: "Formatted at 2026-09-23 14:40:54 on dist-test-slave-54kg"
server_key: "61b4cebd460b1df9c378a76be4477e71"
server_key_iv: "441e5439f0e72017a4894de84e66d875"
server_key_version: "encryptionkey@0"
I20260923 14:40:54.223568 20345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "e69e380308814de4b950e5182c34c136"
format_stamp: "Formatted at 2026-09-23 14:40:54 on dist-test-slave-54kg"
server_key: "61b4cebd460b1df9c378a76be4477e71"
server_key_iv: "441e5439f0e72017a4894de84e66d875"
server_key_version: "encryptionkey@0"
I20260923 14:40:54.226804 20345 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:40:54.228966 20360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:54.230088 20345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:40:54.230180 20345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "e69e380308814de4b950e5182c34c136"
format_stamp: "Formatted at 2026-09-23 14:40:54 on dist-test-slave-54kg"
server_key: "61b4cebd460b1df9c378a76be4477e71"
server_key_iv: "441e5439f0e72017a4894de84e66d875"
server_key_version: "encryptionkey@0"
I20260923 14:40:54.230264 20345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:54.245890 20345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:54.248596 20345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:54.248734 20345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:54.255194 20345 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:38253
I20260923 14:40:54.255486 20412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:38253 every 8 connection(s)
I20260923 14:40:54.256264 20345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:54.257756 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20345
I20260923 14:40:54.257867 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:54.258163 17426 external_mini_cluster.cc:1428] Setting key 4b9ee4976c2137d3e9528d41ce6d545b
I20260923 14:40:54.259452 20413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:54.265723 20413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136: Bootstrap starting.
Sep 23 14:40:54 dist-test-slave-54kg krb5kdc[20332](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:54.268388 20413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:54.269248 20413 log.cc:824] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:54.271476 20413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136: No bootstrap required, opened a new log
I20260923 14:40:54.272173 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:54.259401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.17.4.190:38253)
0923 14:40:54.259845 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:54.259860 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:54.259893 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:40:54.260492 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:54.260506 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:54.260805 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:54.261064 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:54.261920 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:54.262837 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:54.264027 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:54.264478 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:54.264585 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:54.267195 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:54.267201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:54.267216 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:54.267246 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:54.269172 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:54.269626 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:54.269632 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:54.269638 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:54.269761 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:54.270086 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:54.270089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:54.270091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:54.270531 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:54.270765 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:54.270956 (+ 191us) server_negotiation.cc:299] Negotiation successful
0923 14:40:54.271231 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":166,"threads_started":1}
I20260923 14:40:54.274950 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:40:54.275586 20413 raft_consensus.cc:348] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e380308814de4b950e5182c34c136" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38253 } }
I20260923 14:40:54.275839 20413 raft_consensus.cc:374] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:54.275915 20413 raft_consensus.cc:729] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e69e380308814de4b950e5182c34c136, State: Initialized, Role: FOLLOWER
I20260923 14:40:54.276311 20413 consensus_queue.cc:260] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e380308814de4b950e5182c34c136" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38253 } }
I20260923 14:40:54.276424 20413 raft_consensus.cc:388] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:54.276505 20413 raft_consensus.cc:482] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:54.276597 20413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:54.277438 20413 raft_consensus.cc:504] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e380308814de4b950e5182c34c136" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38253 } }
I20260923 14:40:54.277786 20413 leader_election.cc:302] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e69e380308814de4b950e5182c34c136; no voters:
I20260923 14:40:54.278061 20413 leader_election.cc:288] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:54.278175 20419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:54.278417 20419 raft_consensus.cc:686] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [term 1 LEADER]: Becoming Leader. State: Replica: e69e380308814de4b950e5182c34c136, State: Running, Role: LEADER
I20260923 14:40:54.278781 20419 consensus_queue.cc:237] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e380308814de4b950e5182c34c136" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38253 } }
I20260923 14:40:54.279345 20413 sys_catalog.cc:564] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:54.280423 20420 sys_catalog.cc:455] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e69e380308814de4b950e5182c34c136" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e380308814de4b950e5182c34c136" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38253 } } }
I20260923 14:40:54.280624 20420 sys_catalog.cc:458] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:54.280881 20420 sys_catalog.cc:455] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e69e380308814de4b950e5182c34c136. Latest consensus state: current_term: 1 leader_uuid: "e69e380308814de4b950e5182c34c136" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e69e380308814de4b950e5182c34c136" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38253 } } }
I20260923 14:40:54.281023 20420 sys_catalog.cc:458] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136 [sys.catalog]: This master's current role is: LEADER
W20260923 14:40:54.284160 20435 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:40:54.284240 20435 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:40:54.284339 20428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:54.285373 20428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:54.291098 20428 catalog_manager.cc:1347] Generated new cluster ID: d7a636a8f31e47988403458ebe0485f1
I20260923 14:40:54.291157 20428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:54.293100 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:54.288110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42764 (local address 127.17.4.190:38253)
0923 14:40:54.288223 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:54.288227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:54.288462 (+ 235us) server_negotiation.cc:407] Connection header received
0923 14:40:54.288565 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:54.288569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:54.288614 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:54.288712 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:54.289251 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:54.289879 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:54.290704 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:54.290958 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:54.291085 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:54.292145 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:54.292149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:54.292152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:40:54.292643 (+ 491us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:54.292676 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:40:54.292696 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:54.292799 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:54.292904 (+ 105us) server_negotiation.cc:299] Negotiation successful
0923 14:40:54.292964 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:40:54.301323 20428 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:54.302098 20428 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:54.312297 20428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e69e380308814de4b950e5182c34c136: Generated new TSK 0
I20260923 14:40:54.313023 20428 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:40:54.321005 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20345
2026-09-23T14:40:54Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1355 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:54 dist-test-slave-54kg krb5kdc[20446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:54 dist-test-slave-54kg krb5kdc[20446](info): set up 2 sockets
Sep 23 14:40:54 dist-test-slave-54kg krb5kdc[20446](info): commencing operation
krb5kdc: starting...
W20260923 14:40:55.328706 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.989s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:55 dist-test-slave-54kg krb5kdc[20446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:55.446780 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35287
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:35287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:55.552253 20459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:55.552474 20459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:55.552544 20459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:55.556550 20459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:55.556600 20459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:55.556640 20459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:55.556676 20459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:55.556710 20459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:55.561847 20459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:35287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:55.562800 20459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:55.563817 20459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:55.571666 20464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:55.571707 20459 server_base.cc:1034] running on GCE node
W20260923 14:40:55.571743 20465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:55.571666 20467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:55.572432 20459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:55.573514 20459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:55.574704 20459 hybrid_clock.cc:648] HybridClock initialized: now 1790174455574678 us; error 39 us; skew 500 ppm
Sep 23 14:40:55 dist-test-slave-54kg krb5kdc[20446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174455, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:55.577299 20459 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:55.578140 20459 webserver.cc:460] Webserver started at http://127.17.4.190:32925/ using document root <none> and password file <none>
I20260923 14:40:55.578704 20459 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:55.578809 20459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:55.579032 20459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:55.581089 20459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "6dc1821cb56848c099a9edd8911ef75e"
format_stamp: "Formatted at 2026-09-23 14:40:55 on dist-test-slave-54kg"
server_key: "b3fa95ff0d61cf436f301066f31bd41b"
server_key_iv: "355e3b211345feb3657422c521d6561d"
server_key_version: "encryptionkey@0"
I20260923 14:40:55.581638 20459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "6dc1821cb56848c099a9edd8911ef75e"
format_stamp: "Formatted at 2026-09-23 14:40:55 on dist-test-slave-54kg"
server_key: "b3fa95ff0d61cf436f301066f31bd41b"
server_key_iv: "355e3b211345feb3657422c521d6561d"
server_key_version: "encryptionkey@0"
I20260923 14:40:55.585340 20459 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:40:55.587831 20474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:55.589011 20459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:55.589165 20459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "6dc1821cb56848c099a9edd8911ef75e"
format_stamp: "Formatted at 2026-09-23 14:40:55 on dist-test-slave-54kg"
server_key: "b3fa95ff0d61cf436f301066f31bd41b"
server_key_iv: "355e3b211345feb3657422c521d6561d"
server_key_version: "encryptionkey@0"
I20260923 14:40:55.589283 20459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:55.657387 20459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:55.660342 20459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:55.660548 20459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:55.667121 20459 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:35287
I20260923 14:40:55.667227 20526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:35287 every 8 connection(s)
I20260923 14:40:55.668118 20459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:55.670892 20527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:55.673611 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20459
I20260923 14:40:55.673740 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:55.674041 17426 external_mini_cluster.cc:1428] Setting key 99d0bfd5274be569451a3a4cd931fe31
I20260923 14:40:55.677326 20527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e: Bootstrap starting.
I20260923 14:40:55.679605 20527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:55.680421 20527 log.cc:824] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:55.682709 20527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e: No bootstrap required, opened a new log
Sep 23 14:40:55 dist-test-slave-54kg krb5kdc[20446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:55.687077 20527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc1821cb56848c099a9edd8911ef75e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35287 } }
I20260923 14:40:55.687384 20527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:55.687448 20527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dc1821cb56848c099a9edd8911ef75e, State: Initialized, Role: FOLLOWER
I20260923 14:40:55.687958 20527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc1821cb56848c099a9edd8911ef75e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35287 } }
I20260923 14:40:55.688130 20527 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:55.688215 20527 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:55.688352 20527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:55.689535 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:55.675559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40088 (local address 127.17.4.190:35287)
0923 14:40:55.676027 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:55.676042 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:55.676076 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:40:55.676689 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:55.676720 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:55.677048 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:55.677404 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:55.678250 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:55.679260 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:55.680281 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:55.680850 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:55.681020 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:55.683684 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:55.683690 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:55.683706 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:55.683737 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:55.686366 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:55.686827 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:55.686832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:55.686838 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:55.686978 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:55.687233 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:55.687236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:55.687238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:55.687798 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:55.688004 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:55.688261 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 14:40:55.688569 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":142,"threads_started":1}
I20260923 14:40:55.689509 20527 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc1821cb56848c099a9edd8911ef75e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35287 } }
I20260923 14:40:55.689924 20527 leader_election.cc:302] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6dc1821cb56848c099a9edd8911ef75e; no voters:
I20260923 14:40:55.690275 20527 leader_election.cc:288] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:55.690359 20532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:55.690517 20532 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [term 1 LEADER]: Becoming Leader. State: Replica: 6dc1821cb56848c099a9edd8911ef75e, State: Running, Role: LEADER
I20260923 14:40:55.690872 20532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc1821cb56848c099a9edd8911ef75e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35287 } }
I20260923 14:40:55.691531 20527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:55.692562 20534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dc1821cb56848c099a9edd8911ef75e. Latest consensus state: current_term: 1 leader_uuid: "6dc1821cb56848c099a9edd8911ef75e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc1821cb56848c099a9edd8911ef75e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35287 } } }
I20260923 14:40:55.692687 20534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:55.693115 20541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:55.693166 20533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6dc1821cb56848c099a9edd8911ef75e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dc1821cb56848c099a9edd8911ef75e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35287 } } }
I20260923 14:40:55.693337 20533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:55.696581 20541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:55.702003 20541 catalog_manager.cc:1347] Generated new cluster ID: 5c7e83743ca94773b734ed9c95d0d517
I20260923 14:40:55.702086 20541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:55.723042 20541 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:55.724050 20541 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:55.732301 20541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6dc1821cb56848c099a9edd8911ef75e: Generated new TSK 0
I20260923 14:40:55.733040 20541 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:55.758633 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35287
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:55.863775 20553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:55.863998 20553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:55.864037 20553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:55.867827 20553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:55.867870 20553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:55.867925 20553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:55.872774 20553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:55.873723 20553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:55.874603 20553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:55.883605 20561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:55.883782 20553 server_base.cc:1034] running on GCE node
W20260923 14:40:55.883599 20559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:55.883672 20558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:55.884280 20553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:55.884850 20553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:55.886030 20553 hybrid_clock.cc:648] HybridClock initialized: now 1790174455886018 us; error 22 us; skew 500 ppm
Sep 23 14:40:55 dist-test-slave-54kg krb5kdc[20446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174455, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:55.888622 20553 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:55.889400 20553 webserver.cc:460] Webserver started at http://127.17.4.129:46837/ using document root <none> and password file <none>
I20260923 14:40:55.889937 20553 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:55.890024 20553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:55.890244 20553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:55.892314 20553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "1127902f5a184dc3b047d9d0a567d2fd"
format_stamp: "Formatted at 2026-09-23 14:40:55 on dist-test-slave-54kg"
server_key: "8108dd8cdf971e7ea41b3eae35c195c5"
server_key_iv: "49b817056173a4c13ae3ff42a3765af6"
server_key_version: "encryptionkey@0"
I20260923 14:40:55.892859 20553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "1127902f5a184dc3b047d9d0a567d2fd"
format_stamp: "Formatted at 2026-09-23 14:40:55 on dist-test-slave-54kg"
server_key: "8108dd8cdf971e7ea41b3eae35c195c5"
server_key_iv: "49b817056173a4c13ae3ff42a3765af6"
server_key_version: "encryptionkey@0"
I20260923 14:40:55.896440 20553 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:55.898608 20568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:55.899740 20553 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:55.899919 20553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "1127902f5a184dc3b047d9d0a567d2fd"
format_stamp: "Formatted at 2026-09-23 14:40:55 on dist-test-slave-54kg"
server_key: "8108dd8cdf971e7ea41b3eae35c195c5"
server_key_iv: "49b817056173a4c13ae3ff42a3765af6"
server_key_version: "encryptionkey@0"
I20260923 14:40:55.900022 20553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:55.917342 20553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:55.920110 20553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:55.920311 20553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:55.920871 20553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:55.921661 20553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:55.921744 20553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:55.921814 20553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:55.921850 20553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:55.930181 20553 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:33063
I20260923 14:40:55.930207 20681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:33063 every 8 connection(s)
I20260923 14:40:55.931073 20553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:40:55.934083 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20553
I20260923 14:40:55.934207 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:55.934580 17426 external_mini_cluster.cc:1428] Setting key ab22f7a6f5bd34548e3114841febbfef
Sep 23 14:40:55 dist-test-slave-54kg krb5kdc[20446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174455, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:40:55.945752 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:55.932863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53533 (local address 127.17.4.190:35287)
0923 14:40:55.933033 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:55.933038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:55.933831 (+ 793us) server_negotiation.cc:407] Connection header received
0923 14:40:55.935602 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:55.935605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:55.935658 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:55.935794 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:55.937299 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:55.937838 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:55.939037 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:55.939479 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:55.939598 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:55.942037 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:55.942043 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:55.942048 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:55.942083 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:55.943799 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:55.944277 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:55.944283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:55.944287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:55.944380 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:55.944698 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:55.944704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:55.944706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:55.944973 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:55.945080 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:55.945527 (+ 447us) server_negotiation.cc:299] Negotiation successful
0923 14:40:55.945626 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 14:40:55.946655 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:55.933259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35287 (local address 127.17.4.129:53533)
0923 14:40:55.933680 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:55.933724 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:55.935396 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:55.935982 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:55.935989 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:55.936473 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:55.937138 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:55.937159 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:55.937965 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:55.937968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:55.938911 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:55.938921 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:55.939619 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:55.939622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:55.939830 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:55.940468 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:55.940483 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:55.941872 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:55.943909 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:55.943913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:55.943924 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:55.944164 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:55.944472 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:55.944474 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:55.944476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:55.944608 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:55.945091 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:55.945096 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:55.945321 (+ 225us) client_negotiation.cc:769] Sending connection context
0923 14:40:55.945475 (+ 154us) client_negotiation.cc:240] Negotiation successful
0923 14:40:55.945733 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":96,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:40:55.948081 20682 heartbeater.cc:347] Connected to a master server at 127.17.4.190:35287
I20260923 14:40:55.948328 20682 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:55.948860 20682 heartbeater.cc:511] Master 127.17.4.190:35287 requested a full tablet report, sending...
I20260923 14:40:55.950397 20490 ts_manager.cc:194] Registered new tserver with Master: 1127902f5a184dc3b047d9d0a567d2fd (127.17.4.129:33063)
I20260923 14:40:55.951493 20490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:53533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:55.965487 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35287
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:56.084460 20687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:56.084694 20687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:56.084764 20687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:56.088653 20687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:56.088701 20687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:56.088769 20687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:56.093851 20687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:56.094739 20687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:56.095646 20687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:56.104497 20692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:56.104530 20693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:56.104588 20687 server_base.cc:1034] running on GCE node
W20260923 14:40:56.104530 20695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:56.105132 20687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:56.105705 20687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:56.106858 20687 hybrid_clock.cc:648] HybridClock initialized: now 1790174456106843 us; error 23 us; skew 500 ppm
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174456, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:56.109441 20687 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:56.110253 20687 webserver.cc:460] Webserver started at http://127.17.4.130:45575/ using document root <none> and password file <none>
I20260923 14:40:56.110785 20687 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:56.110885 20687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:56.111099 20687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:56.112993 20687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "9cb9e6964f9d49189b688bef771c2ab2"
format_stamp: "Formatted at 2026-09-23 14:40:56 on dist-test-slave-54kg"
server_key: "0cd28364d647d387ee5b986730ac83ea"
server_key_iv: "ba6050ab7f27a76f2b953311dd6655ef"
server_key_version: "encryptionkey@0"
I20260923 14:40:56.113554 20687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "9cb9e6964f9d49189b688bef771c2ab2"
format_stamp: "Formatted at 2026-09-23 14:40:56 on dist-test-slave-54kg"
server_key: "0cd28364d647d387ee5b986730ac83ea"
server_key_iv: "ba6050ab7f27a76f2b953311dd6655ef"
server_key_version: "encryptionkey@0"
I20260923 14:40:56.117156 20687 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:40:56.119341 20702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:56.120615 20687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:40:56.120762 20687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "9cb9e6964f9d49189b688bef771c2ab2"
format_stamp: "Formatted at 2026-09-23 14:40:56 on dist-test-slave-54kg"
server_key: "0cd28364d647d387ee5b986730ac83ea"
server_key_iv: "ba6050ab7f27a76f2b953311dd6655ef"
server_key_version: "encryptionkey@0"
I20260923 14:40:56.120875 20687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:56.144665 20687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:56.147893 20687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:56.148089 20687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:56.148658 20687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:56.149418 20687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:56.149488 20687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:56.149556 20687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:56.149598 20687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:56.158599 20687 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:38377
I20260923 14:40:56.158672 20815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:38377 every 8 connection(s)
I20260923 14:40:56.159502 20687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:56.162542 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20687
I20260923 14:40:56.162694 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:56.163028 17426 external_mini_cluster.cc:1428] Setting key 26f8a94efc6df9adc471b24d1a86a9c0
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174456, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:40:56.174610 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:56.161258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:39203 (local address 127.17.4.190:35287)
0923 14:40:56.161384 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:56.161388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:56.162162 (+ 774us) server_negotiation.cc:407] Connection header received
0923 14:40:56.163908 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:56.163910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:56.163951 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:56.164005 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:56.165457 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.165976 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.167358 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.167793 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.167918 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:56.170742 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:56.170746 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:56.170749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:56.170780 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:56.172567 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:56.173041 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:56.173046 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:56.173048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:56.173159 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:56.173518 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:56.173520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:56.173521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:56.173693 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:56.173772 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:56.174312 (+ 540us) server_negotiation.cc:299] Negotiation successful
0923 14:40:56.174436 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:40:56.175454 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:56.161610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35287 (local address 127.17.4.130:39203)
0923 14:40:56.162025 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:56.162065 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:56.163673 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:56.164177 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:56.164185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:56.164624 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:56.165290 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:56.165312 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.166134 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.166141 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:56.167241 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:56.167255 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.167977 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.167985 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:56.168194 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:56.168835 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:56.168860 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:56.170571 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:56.172690 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:56.172695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:56.172706 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:56.172941 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:56.173277 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:56.173280 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:56.173281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:56.173410 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:56.173785 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:56.173790 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:56.174007 (+ 217us) client_negotiation.cc:769] Sending connection context
0923 14:40:56.174249 (+ 242us) client_negotiation.cc:240] Negotiation successful
0923 14:40:56.174568 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:40:56.176641 20816 heartbeater.cc:347] Connected to a master server at 127.17.4.190:35287
I20260923 14:40:56.176890 20816 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:56.177456 20816 heartbeater.cc:511] Master 127.17.4.190:35287 requested a full tablet report, sending...
I20260923 14:40:56.178576 20490 ts_manager.cc:194] Registered new tserver with Master: 9cb9e6964f9d49189b688bef771c2ab2 (127.17.4.130:38377)
I20260923 14:40:56.179116 20490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:39203
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:56.190943 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35287
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:56.296903 20821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:56.297149 20821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:56.297191 20821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:56.301388 20821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:56.301469 20821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:56.301525 20821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:56.306767 20821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:56.307696 20821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:56.308667 20821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:56.318291 20829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:56.318375 20826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:56.318332 20827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:56.318531 20821 server_base.cc:1034] running on GCE node
I20260923 14:40:56.318977 20821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:56.319561 20821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:56.320740 20821 hybrid_clock.cc:648] HybridClock initialized: now 1790174456320704 us; error 50 us; skew 500 ppm
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174456, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:56.323273 20821 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:56.324180 20821 webserver.cc:460] Webserver started at http://127.17.4.131:45217/ using document root <none> and password file <none>
I20260923 14:40:56.324729 20821 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:56.324788 20821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:56.324946 20821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:56.326886 20821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "79edc1602660472289b081b9c6da01a9"
format_stamp: "Formatted at 2026-09-23 14:40:56 on dist-test-slave-54kg"
server_key: "04fcd7d6f74d90adbca7df3841267ba2"
server_key_iv: "8f117b511295ba66505d96d085d9bbc0"
server_key_version: "encryptionkey@0"
I20260923 14:40:56.327361 20821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "79edc1602660472289b081b9c6da01a9"
format_stamp: "Formatted at 2026-09-23 14:40:56 on dist-test-slave-54kg"
server_key: "04fcd7d6f74d90adbca7df3841267ba2"
server_key_iv: "8f117b511295ba66505d96d085d9bbc0"
server_key_version: "encryptionkey@0"
I20260923 14:40:56.330670 20821 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:40:56.332803 20836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:56.333930 20821 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:40:56.334045 20821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "79edc1602660472289b081b9c6da01a9"
format_stamp: "Formatted at 2026-09-23 14:40:56 on dist-test-slave-54kg"
server_key: "04fcd7d6f74d90adbca7df3841267ba2"
server_key_iv: "8f117b511295ba66505d96d085d9bbc0"
server_key_version: "encryptionkey@0"
I20260923 14:40:56.334141 20821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:56.352634 20821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:56.355195 20821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:56.355368 20821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:56.355940 20821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:56.356909 20821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:56.356983 20821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:56.357044 20821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:56.357079 20821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:56.365512 20821 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:44837
I20260923 14:40:56.365541 20949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:44837 every 8 connection(s)
I20260923 14:40:56.366291 20821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:56.366660 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20821
I20260923 14:40:56.366780 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:40:56.367089 17426 external_mini_cluster.cc:1428] Setting key 2ed6fdfcdd67ba87968df5126b0c5188
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174456, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:56.379014 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:56.368070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:36229 (local address 127.17.4.190:35287)
0923 14:40:56.368177 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:56.368183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:56.369154 (+ 971us) server_negotiation.cc:407] Connection header received
0923 14:40:56.370511 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:56.370513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:56.370556 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:56.370642 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:56.371685 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.372293 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.373378 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.373596 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.373683 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:56.375930 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:56.375933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:56.375935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:56.375957 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:56.377376 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:56.377808 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:56.377810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:56.377811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:56.377881 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:56.378142 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:56.378144 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:56.378145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:56.378297 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:56.378368 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:56.378759 (+ 391us) server_negotiation.cc:299] Negotiation successful
0923 14:40:56.378856 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 14:40:56.379971 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:56.368498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35287 (local address 127.17.4.131:36229)
0923 14:40:56.369016 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:56.369052 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:56.370326 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:56.370788 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:56.370793 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:56.371106 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:56.371556 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:56.371568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.372396 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.372398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:56.373238 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:56.373246 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.373720 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.373722 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:56.373853 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:56.374320 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:56.374334 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:56.375728 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:56.377465 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:56.377469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:56.377477 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:56.377727 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:56.377955 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:56.377957 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:56.377958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:56.378071 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:56.378378 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:56.378382 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:56.378576 (+ 194us) client_negotiation.cc:769] Sending connection context
0923 14:40:56.378715 (+ 139us) client_negotiation.cc:240] Negotiation successful
0923 14:40:56.378958 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":134,"threads_started":1}
I20260923 14:40:56.381043 20950 heartbeater.cc:347] Connected to a master server at 127.17.4.190:35287
I20260923 14:40:56.381263 20950 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:56.381699 20950 heartbeater.cc:511] Master 127.17.4.190:35287 requested a full tablet report, sending...
I20260923 14:40:56.382637 20490 ts_manager.cc:194] Registered new tserver with Master: 79edc1602660472289b081b9c6da01a9 (127.17.4.131:44837)
I20260923 14:40:56.383137 20490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:36229
I20260923 14:40:56.392848 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174456, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174456, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:56.417305 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:56.409131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40090 (local address 127.17.4.190:35287)
0923 14:40:56.409261 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:56.409265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:56.409421 (+ 156us) server_negotiation.cc:407] Connection header received
0923 14:40:56.409550 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:56.409553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:56.409593 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:56.409668 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:56.410328 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.410866 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.411676 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:56.411943 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:56.412025 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:56.414466 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:56.414469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:56.414471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:56.414494 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:56.415952 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:56.416330 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:56.416333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:56.416334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:56.416403 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:56.416619 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:56.416621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:56.416622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:56.416827 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:56.416923 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:56.417104 (+ 181us) server_negotiation.cc:299] Negotiation successful
0923 14:40:56.417190 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260923 14:40:56.417760 20490 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40090
I20260923 14:40:56.418764 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20553
I20260923 14:40:56.424098 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20687
I20260923 14:40:56.429102 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20821
I20260923 14:40:56.434314 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20459
2026-09-23T14:40:56Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2115 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20962](info): set up 2 sockets
Sep 23 14:40:56 dist-test-slave-54kg krb5kdc[20962](info): commencing operation
krb5kdc: starting...
W20260923 14:40:57.448782 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.993s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:57 dist-test-slave-54kg krb5kdc[20962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:57.563402 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:37761
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:37761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:57.670506 20975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:57.670759 20975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:57.670799 20975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:57.675045 20975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:57.675122 20975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:57.675141 20975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:57.675158 20975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:57.675172 20975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:57.680773 20975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:37761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:37761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:57.681773 20975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:57.682750 20975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:57.690876 20980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:57.691066 20975 server_base.cc:1034] running on GCE node
W20260923 14:40:57.691149 20983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:57.690882 20981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:57.691944 20975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:57.692966 20975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:57.694180 20975 hybrid_clock.cc:648] HybridClock initialized: now 1790174457694166 us; error 32 us; skew 500 ppm
Sep 23 14:40:57 dist-test-slave-54kg krb5kdc[20962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:57.702616 20975 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:57.703414 20975 webserver.cc:460] Webserver started at http://127.17.4.190:43653/ using document root <none> and password file <none>
I20260923 14:40:57.704036 20975 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:57.704125 20975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:57.704351 20975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:57.706264 20975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "3dde48dd8f6e4542a671333b7722ca0d"
format_stamp: "Formatted at 2026-09-23 14:40:57 on dist-test-slave-54kg"
server_key: "759969ede67ece776f0b4406040737b6"
server_key_iv: "388d15cf6b4b0beefbcaf369faf873eb"
server_key_version: "encryptionkey@0"
I20260923 14:40:57.706825 20975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "3dde48dd8f6e4542a671333b7722ca0d"
format_stamp: "Formatted at 2026-09-23 14:40:57 on dist-test-slave-54kg"
server_key: "759969ede67ece776f0b4406040737b6"
server_key_iv: "388d15cf6b4b0beefbcaf369faf873eb"
server_key_version: "encryptionkey@0"
I20260923 14:40:57.710343 20975 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 14:40:57.712585 20990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:57.713703 20975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:57.713840 20975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "3dde48dd8f6e4542a671333b7722ca0d"
format_stamp: "Formatted at 2026-09-23 14:40:57 on dist-test-slave-54kg"
server_key: "759969ede67ece776f0b4406040737b6"
server_key_iv: "388d15cf6b4b0beefbcaf369faf873eb"
server_key_version: "encryptionkey@0"
I20260923 14:40:57.713943 20975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:57.732666 20975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:57.735266 20975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:57.735455 20975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:57.742101 20975 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:37761
I20260923 14:40:57.742163 21042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:37761 every 8 connection(s)
I20260923 14:40:57.743026 20975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:57.745654 21043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:57.748507 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 20975
I20260923 14:40:57.748608 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:57.748878 17426 external_mini_cluster.cc:1428] Setting key 5fb343c7cc54e45d45216e2c2e2d1d9c
I20260923 14:40:57.751293 21043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d: Bootstrap starting.
I20260923 14:40:57.753815 21043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:57.754616 21043 log.cc:824] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:57.756688 21043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d: No bootstrap required, opened a new log
Sep 23 14:40:57 dist-test-slave-54kg krb5kdc[20962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:57.760231 21043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dde48dd8f6e4542a671333b7722ca0d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37761 } }
I20260923 14:40:57.760493 21043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:57.760552 21043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dde48dd8f6e4542a671333b7722ca0d, State: Initialized, Role: FOLLOWER
I20260923 14:40:57.761008 21043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dde48dd8f6e4542a671333b7722ca0d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37761 } }
I20260923 14:40:57.761165 21043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:57.761250 21043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:57.761346 21043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:57.762390 21043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dde48dd8f6e4542a671333b7722ca0d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37761 } }
I20260923 14:40:57.762717 21043 leader_election.cc:302] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dde48dd8f6e4542a671333b7722ca0d; no voters:
I20260923 14:40:57.763024 21043 leader_election.cc:288] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:57.763108 21048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:57.763393 21048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [term 1 LEADER]: Becoming Leader. State: Replica: 3dde48dd8f6e4542a671333b7722ca0d, State: Running, Role: LEADER
I20260923 14:40:57.763764 21048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dde48dd8f6e4542a671333b7722ca0d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37761 } }
I20260923 14:40:57.764328 21043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:57.764501 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:57.750227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52360 (local address 127.17.4.190:37761)
0923 14:40:57.750619 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:57.750637 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:57.750676 (+ 39us) server_negotiation.cc:407] Connection header received
0923 14:40:57.751455 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:57.751476 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:57.751886 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:57.752210 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:57.752894 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:57.754351 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:57.755426 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:57.756120 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:57.756280 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:57.758577 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:57.758584 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:57.758598 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:57.758629 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:57.761094 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:57.761597 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:57.761603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:57.761609 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:57.761743 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:57.761986 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:57.761989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:57.761991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:57.762503 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:57.762670 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:57.763110 (+ 440us) server_negotiation.cc:299] Negotiation successful
0923 14:40:57.763562 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":103,"threads_started":1}
I20260923 14:40:57.766074 21049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dde48dd8f6e4542a671333b7722ca0d. Latest consensus state: current_term: 1 leader_uuid: "3dde48dd8f6e4542a671333b7722ca0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dde48dd8f6e4542a671333b7722ca0d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37761 } } }
I20260923 14:40:57.766192 21049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:57.766376 21049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3dde48dd8f6e4542a671333b7722ca0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dde48dd8f6e4542a671333b7722ca0d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37761 } } }
I20260923 14:40:57.766469 21049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d [sys.catalog]: This master's current role is: LEADER
W20260923 14:40:57.768775 21062 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:40:57.768836 21062 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:40:57.768916 21063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:57.769577 21063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:57.774657 21063 catalog_manager.cc:1347] Generated new cluster ID: 489e86092c774e29871eb17fb3dc69f5
I20260923 14:40:57.774716 21063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:57.782603 21063 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:57.783722 21063 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:57.794726 21063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3dde48dd8f6e4542a671333b7722ca0d: Generated new TSK 0
I20260923 14:40:57.795310 21063 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:57.826395 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37761
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:57.931003 21069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:57.931224 21069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:57.931262 21069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:57.935217 21069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:57.935267 21069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:57.935348 21069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:40:57.940701 21069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:57.941596 21069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:57.942529 21069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:57.951426 21074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:57.951421 21075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:57.951699 21069 server_base.cc:1034] running on GCE node
W20260923 14:40:57.951442 21077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:57.952178 21069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:57.952744 21069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:57.953927 21069 hybrid_clock.cc:648] HybridClock initialized: now 1790174457953912 us; error 30 us; skew 500 ppm
Sep 23 14:40:57 dist-test-slave-54kg krb5kdc[20962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:57.956534 21069 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:40:57.957309 21069 webserver.cc:460] Webserver started at http://127.17.4.129:33419/ using document root <none> and password file <none>
I20260923 14:40:57.957847 21069 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:57.957935 21069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:57.958161 21069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:57.960100 21069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "fac57fff0cbd4dd68e392a33e69c8cd4"
format_stamp: "Formatted at 2026-09-23 14:40:57 on dist-test-slave-54kg"
server_key: "a9b298032fde9162db6b77afe09bd18d"
server_key_iv: "2922efc8102383e9f86649708a1676e5"
server_key_version: "encryptionkey@0"
I20260923 14:40:57.960661 21069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "fac57fff0cbd4dd68e392a33e69c8cd4"
format_stamp: "Formatted at 2026-09-23 14:40:57 on dist-test-slave-54kg"
server_key: "a9b298032fde9162db6b77afe09bd18d"
server_key_iv: "2922efc8102383e9f86649708a1676e5"
server_key_version: "encryptionkey@0"
I20260923 14:40:57.964237 21069 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:57.966749 21084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:57.968307 21069 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:57.968438 21069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "fac57fff0cbd4dd68e392a33e69c8cd4"
format_stamp: "Formatted at 2026-09-23 14:40:57 on dist-test-slave-54kg"
server_key: "a9b298032fde9162db6b77afe09bd18d"
server_key_iv: "2922efc8102383e9f86649708a1676e5"
server_key_version: "encryptionkey@0"
I20260923 14:40:57.968544 21069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:57.981977 21069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:57.984486 21069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:57.984673 21069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:57.985198 21069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:57.985917 21069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:57.985985 21069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:57.986047 21069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:57.986092 21069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:57.994356 21069 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:42873
I20260923 14:40:57.994405 21197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:42873 every 8 connection(s)
I20260923 14:40:57.995217 21069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:40:58.002270 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21069
I20260923 14:40:58.002388 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:40:58.002720 17426 external_mini_cluster.cc:1428] Setting key 8398b22905f4bb48f1415d85cab1fba7
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:58.009291 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:57.996874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:48553 (local address 127.17.4.190:37761)
0923 14:40:57.997000 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:57.997003 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:57.997764 (+ 761us) server_negotiation.cc:407] Connection header received
0923 14:40:57.999059 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:57.999062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:57.999125 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:57.999197 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:58.000351 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.000899 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.002068 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.002459 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.002577 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.005023 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:58.005030 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:58.005035 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:58.005069 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:58.006764 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.007405 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.007408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.007409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.007484 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.007921 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.007924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.007925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.008158 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:58.008265 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:58.008921 (+ 656us) server_negotiation.cc:299] Negotiation successful
0923 14:40:58.009061 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:40:58.010012 21200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:57.997216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37761 (local address 127.17.4.129:48553)
0923 14:40:57.997623 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:57.997662 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:57.998866 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:57.999365 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:57.999371 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:57.999708 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:58.000225 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:58.000237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.001000 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.001003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:58.001855 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:58.001863 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.002601 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.002604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:58.002742 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.003394 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:58.003410 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:58.004861 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:58.006883 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:58.006892 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:58.006909 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:58.007290 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:58.007588 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:58.007594 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:58.007599 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:58.007795 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:58.008292 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:58.008301 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:58.008616 (+ 315us) client_negotiation.cc:769] Sending connection context
0923 14:40:58.008821 (+ 205us) client_negotiation.cc:240] Negotiation successful
0923 14:40:58.009113 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":97,"threads_started":1}
I20260923 14:40:58.011234 21198 heartbeater.cc:347] Connected to a master server at 127.17.4.190:37761
I20260923 14:40:58.011456 21198 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:58.011981 21198 heartbeater.cc:511] Master 127.17.4.190:37761 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:40:58.013422 21007 ts_manager.cc:194] Registered new tserver with Master: fac57fff0cbd4dd68e392a33e69c8cd4 (127.17.4.129:42873)
I20260923 14:40:58.014544 21007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:48553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:40:58.030475 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37761
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:58.134733 21203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:58.134984 21203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:58.135022 21203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:58.139570 21203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:58.139621 21203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:58.139681 21203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:40:58.144541 21203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:58.145478 21203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:58.146433 21203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:58.155586 21208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:58.155705 21203 server_base.cc:1034] running on GCE node
W20260923 14:40:58.155598 21209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:58.155597 21211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:58.156227 21203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:58.156746 21203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:58.157908 21203 hybrid_clock.cc:648] HybridClock initialized: now 1790174458157893 us; error 23 us; skew 500 ppm
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:58.160586 21203 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:40:58.161327 21203 webserver.cc:460] Webserver started at http://127.17.4.130:41595/ using document root <none> and password file <none>
I20260923 14:40:58.161859 21203 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:58.161943 21203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:58.162153 21203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:58.164165 21203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "cb6a8e9df99341a3b98d346bd00d9194"
format_stamp: "Formatted at 2026-09-23 14:40:58 on dist-test-slave-54kg"
server_key: "5c6deb67e8390b32f6ce1c2eb70b969c"
server_key_iv: "e0edfc3aae3cc98aba3352eca192c4a4"
server_key_version: "encryptionkey@0"
I20260923 14:40:58.164754 21203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "cb6a8e9df99341a3b98d346bd00d9194"
format_stamp: "Formatted at 2026-09-23 14:40:58 on dist-test-slave-54kg"
server_key: "5c6deb67e8390b32f6ce1c2eb70b969c"
server_key_iv: "e0edfc3aae3cc98aba3352eca192c4a4"
server_key_version: "encryptionkey@0"
I20260923 14:40:58.168464 21203 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:58.170747 21218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:58.172006 21203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:58.172137 21203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "cb6a8e9df99341a3b98d346bd00d9194"
format_stamp: "Formatted at 2026-09-23 14:40:58 on dist-test-slave-54kg"
server_key: "5c6deb67e8390b32f6ce1c2eb70b969c"
server_key_iv: "e0edfc3aae3cc98aba3352eca192c4a4"
server_key_version: "encryptionkey@0"
I20260923 14:40:58.172255 21203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:58.188001 21203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:58.190761 21203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:58.190974 21203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:58.191542 21203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:58.192418 21203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:58.192488 21203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:58.192557 21203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:58.192605 21203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:58.201249 21203 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:43669
I20260923 14:40:58.201277 21331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:43669 every 8 connection(s)
I20260923 14:40:58.202097 21203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:40:58.205886 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21203
I20260923 14:40:58.206000 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:40:58.206317 17426 external_mini_cluster.cc:1428] Setting key 7647c14dc2132118dce436049d21bcb6
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:40:58.216549 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:58.203894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41719 (local address 127.17.4.190:37761)
0923 14:40:58.204025 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:58.204029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:58.204808 (+ 779us) server_negotiation.cc:407] Connection header received
0923 14:40:58.206239 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:58.206243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:58.206287 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:58.206378 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:58.207638 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.208361 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.209887 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.210122 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.210246 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.212928 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:58.212932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:58.212937 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:58.212965 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:58.214413 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.214943 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.214946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.214948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.215028 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.215394 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.215397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.215398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.215591 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:58.215710 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:58.216224 (+ 514us) server_negotiation.cc:299] Negotiation successful
0923 14:40:58.216381 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:40:58.217418 21334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:58.204240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37761 (local address 127.17.4.130:41719)
0923 14:40:58.204639 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:58.204679 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:58.206028 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:58.206527 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:58.206535 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:58.206968 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:58.207489 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:58.207506 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.208484 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.208490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:58.209765 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:58.209775 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.210283 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.210287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:58.210498 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.211071 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:58.211095 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:58.212764 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:58.214550 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:58.214555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:58.214569 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:58.214839 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:58.215132 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:58.215135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:58.215137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:58.215268 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:58.215707 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:58.215713 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:58.215987 (+ 274us) client_negotiation.cc:769] Sending connection context
0923 14:40:58.216183 (+ 196us) client_negotiation.cc:240] Negotiation successful
0923 14:40:58.216490 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":99,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:40:58.218636 21332 heartbeater.cc:347] Connected to a master server at 127.17.4.190:37761
I20260923 14:40:58.218890 21332 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:58.219484 21332 heartbeater.cc:511] Master 127.17.4.190:37761 requested a full tablet report, sending...
I20260923 14:40:58.220669 21007 ts_manager.cc:194] Registered new tserver with Master: cb6a8e9df99341a3b98d346bd00d9194 (127.17.4.130:43669)
I20260923 14:40:58.221228 21007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:41719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:40:58.234301 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37761
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:58.342963 21337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:58.343199 21337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:58.343240 21337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:58.347251 21337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:58.347301 21337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:58.347400 21337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:40:58.352555 21337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:58.353461 21337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:58.354424 21337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:58.363828 21342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:58.363895 21337 server_base.cc:1034] running on GCE node
W20260923 14:40:58.363807 21345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:58.363905 21343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:58.364543 21337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:58.365085 21337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:58.366245 21337 hybrid_clock.cc:648] HybridClock initialized: now 1790174458366236 us; error 33 us; skew 500 ppm
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:58.369005 21337 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:40:58.369887 21337 webserver.cc:460] Webserver started at http://127.17.4.131:41895/ using document root <none> and password file <none>
I20260923 14:40:58.370433 21337 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:58.370504 21337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:58.370741 21337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:58.372910 21337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "4d197ad931c24569b751eba45ef4e462"
format_stamp: "Formatted at 2026-09-23 14:40:58 on dist-test-slave-54kg"
server_key: "3b87502a3832751189bb7e0b04059bb4"
server_key_iv: "610aa84a81647e1f21c657f8c43f4435"
server_key_version: "encryptionkey@0"
I20260923 14:40:58.373463 21337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "4d197ad931c24569b751eba45ef4e462"
format_stamp: "Formatted at 2026-09-23 14:40:58 on dist-test-slave-54kg"
server_key: "3b87502a3832751189bb7e0b04059bb4"
server_key_iv: "610aa84a81647e1f21c657f8c43f4435"
server_key_version: "encryptionkey@0"
I20260923 14:40:58.377254 21337 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 14:40:58.379724 21352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:58.381086 21337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:40:58.381242 21337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "4d197ad931c24569b751eba45ef4e462"
format_stamp: "Formatted at 2026-09-23 14:40:58 on dist-test-slave-54kg"
server_key: "3b87502a3832751189bb7e0b04059bb4"
server_key_iv: "610aa84a81647e1f21c657f8c43f4435"
server_key_version: "encryptionkey@0"
I20260923 14:40:58.381357 21337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:58.428239 21337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:58.431279 21337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:58.431488 21337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:58.432128 21337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:40:58.432963 21337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:40:58.433032 21337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:58.433104 21337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:40:58.433153 21337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:58.441869 21337 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:44055
I20260923 14:40:58.441892 21465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:44055 every 8 connection(s)
I20260923 14:40:58.442726 21337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:40:58.450832 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21337
I20260923 14:40:58.450960 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:40:58.451251 17426 external_mini_cluster.cc:1428] Setting key 11ad7a0012185f3ba39154212e2fb19e
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:58.456266 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:58.444539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:35423 (local address 127.17.4.190:37761)
0923 14:40:58.444700 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:58.444704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:58.445528 (+ 824us) server_negotiation.cc:407] Connection header received
0923 14:40:58.446845 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:58.446849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:58.446894 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:58.446968 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:58.448187 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.448710 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.449834 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.450043 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.450127 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.452947 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:58.452951 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:58.452954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:58.452982 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:58.454415 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.454898 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.454901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.454902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.454977 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.455264 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.455266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.455268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.455434 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:58.455509 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:58.456054 (+ 545us) server_negotiation.cc:299] Negotiation successful
0923 14:40:58.456155 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 14:40:58.457024 21468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:58.444918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37761 (local address 127.17.4.131:35423)
0923 14:40:58.445359 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0923 14:40:58.445402 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:40:58.446646 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:40:58.447152 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:40:58.447158 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:40:58.447500 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:40:58.448055 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:58.448069 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.448819 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.448822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:58.449718 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:40:58.449727 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.450169 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.450171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:40:58.450304 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.450862 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:40:58.450884 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:40:58.452744 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:40:58.454516 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:58.454520 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:58.454531 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:58.454811 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:58.455056 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:40:58.455058 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:40:58.455060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:40:58.455186 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:40:58.455517 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:40:58.455521 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:40:58.455756 (+ 235us) client_negotiation.cc:769] Sending connection context
0923 14:40:58.455985 (+ 229us) client_negotiation.cc:240] Negotiation successful
0923 14:40:58.456228 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":112,"threads_started":1}
I20260923 14:40:58.458132 21466 heartbeater.cc:347] Connected to a master server at 127.17.4.190:37761
I20260923 14:40:58.458359 21466 heartbeater.cc:464] Registering TS with master...
I20260923 14:40:58.458806 21466 heartbeater.cc:511] Master 127.17.4.190:37761 requested a full tablet report, sending...
I20260923 14:40:58.459743 21007 ts_manager.cc:194] Registered new tserver with Master: 4d197ad931c24569b751eba45ef4e462 (127.17.4.131:44055)
I20260923 14:40:58.460359 21007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:35423
I20260923 14:40:58.465102 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:40:58.490738 21473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:58.480962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52786 (local address 127.17.4.129:42873)
0923 14:40:58.481246 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:58.481261 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:58.481290 (+ 29us) server_negotiation.cc:407] Connection header received
0923 14:40:58.481357 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:58.481370 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:58.481590 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:58.481747 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:58.482429 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.483204 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.484110 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.484475 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.484621 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.487357 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:58.487366 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:58.487378 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:58.487402 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:58.488987 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.489425 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.489430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.489432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.489507 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.489790 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.489794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.489796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.490021 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:58.490246 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:58.490409 (+ 163us) server_negotiation.cc:299] Negotiation successful
0923 14:40:58.490567 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[20962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:58.501420 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:58.493415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52372 (local address 127.17.4.190:37761)
0923 14:40:58.493561 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:58.493566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:58.493613 (+ 47us) server_negotiation.cc:407] Connection header received
0923 14:40:58.493768 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:58.493771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:58.493820 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:58.493903 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:58.494474 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.494984 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.495754 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:58.496022 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:58.496136 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:58.498303 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:58.498307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:58.498312 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:58.498340 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:58.499672 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.500161 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.500165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.500167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.500248 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:58.500519 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:58.500523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:58.500525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:58.500768 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:58.500906 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:58.501138 (+ 232us) server_negotiation.cc:299] Negotiation successful
0923 14:40:58.501254 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260923 14:40:58.501937 21007 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52372
I20260923 14:40:58.502557 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21069
I20260923 14:40:58.508081 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21203
I20260923 14:40:58.513476 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21337
I20260923 14:40:58.518663 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 20975
2026-09-23T14:40:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2084 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[21478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[21478](info): set up 2 sockets
Sep 23 14:40:58 dist-test-slave-54kg krb5kdc[21478](info): commencing operation
krb5kdc: starting...
W20260923 14:40:59.536760 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.997s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:40:59 dist-test-slave-54kg krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:40:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:40:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:40:59.660890 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46871
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:37689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:40:59.767861 21491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:40:59.768154 21491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:40:59.768226 21491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:40:59.772158 21491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:40:59.772239 21491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:40:59.772279 21491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:40:59.772336 21491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:40:59.772377 21491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:40:59.777520 21491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:37689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:40:59.778620 21491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:40:59.779645 21491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:40:59.787809 21499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:40:59.787755 21497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:59.787930 21491 server_base.cc:1034] running on GCE node
W20260923 14:40:59.787756 21496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:40:59.788551 21491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:40:59.789630 21491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:40:59.790820 21491 hybrid_clock.cc:648] HybridClock initialized: now 1790174459790795 us; error 44 us; skew 500 ppm
Sep 23 14:40:59 dist-test-slave-54kg krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174459, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:40:59.793489 21491 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:40:59.794206 21491 fs_manager.cc:359] Metadata directory not provided
I20260923 14:40:59.794298 21491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:40:59.794528 21491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:40:59.796572 21491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "a09fdfef97e340beaa7093730bdeb8b3"
format_stamp: "Formatted at 2026-09-23 14:40:59 on dist-test-slave-54kg"
server_key: "76e6954db35b9e8f42c7b6b0c5519697"
server_key_iv: "2a97714bbd3aeaeac34c9409354a2be6"
server_key_version: "encryptionkey@0"
I20260923 14:40:59.797102 21491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "a09fdfef97e340beaa7093730bdeb8b3"
format_stamp: "Formatted at 2026-09-23 14:40:59 on dist-test-slave-54kg"
server_key: "76e6954db35b9e8f42c7b6b0c5519697"
server_key_iv: "2a97714bbd3aeaeac34c9409354a2be6"
server_key_version: "encryptionkey@0"
I20260923 14:40:59.800561 21491 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:40:59.802672 21505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:40:59.803886 21491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260923 14:40:59.804015 21491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "a09fdfef97e340beaa7093730bdeb8b3"
format_stamp: "Formatted at 2026-09-23 14:40:59 on dist-test-slave-54kg"
server_key: "76e6954db35b9e8f42c7b6b0c5519697"
server_key_iv: "2a97714bbd3aeaeac34c9409354a2be6"
server_key_version: "encryptionkey@0"
I20260923 14:40:59.804118 21491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:40:59.828372 21491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:40:59.831007 21491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:40:59.831138 21491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:40:59.837442 21491 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:46871
I20260923 14:40:59.837741 21557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:46871 every 8 connection(s)
I20260923 14:40:59.838128 21491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:40:59.840699 21558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:40:59.845691 21558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3: Bootstrap starting.
I20260923 14:40:59.846628 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21491
I20260923 14:40:59.846714 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:40:59.846956 17426 external_mini_cluster.cc:1428] Setting key 5cccbf679971b4a568ed9c9aef7bbcbd
I20260923 14:40:59.848116 21558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3: Neither blocks nor log segments found. Creating new log.
I20260923 14:40:59.848815 21558 log.cc:824] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3: Log is configured to *not* fsync() on all Append() calls
I20260923 14:40:59.850781 21558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3: No bootstrap required, opened a new log
I20260923 14:40:59.854470 21558 raft_consensus.cc:348] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09fdfef97e340beaa7093730bdeb8b3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46871 } }
I20260923 14:40:59.854694 21558 raft_consensus.cc:374] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:40:59.854782 21558 raft_consensus.cc:729] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09fdfef97e340beaa7093730bdeb8b3, State: Initialized, Role: FOLLOWER
Sep 23 14:40:59 dist-test-slave-54kg krb5kdc[21478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:40:59.855221 21558 consensus_queue.cc:260] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09fdfef97e340beaa7093730bdeb8b3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46871 } }
I20260923 14:40:59.855365 21558 raft_consensus.cc:388] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:40:59.855436 21558 raft_consensus.cc:482] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:40:59.855556 21558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:40:59.856629 21558 raft_consensus.cc:504] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09fdfef97e340beaa7093730bdeb8b3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46871 } }
I20260923 14:40:59.856962 21558 leader_election.cc:302] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a09fdfef97e340beaa7093730bdeb8b3; no voters:
I20260923 14:40:59.857275 21558 leader_election.cc:288] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:40:59.857364 21563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:40:59.857647 21563 raft_consensus.cc:686] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [term 1 LEADER]: Becoming Leader. State: Replica: a09fdfef97e340beaa7093730bdeb8b3, State: Running, Role: LEADER
I20260923 14:40:59.857964 21563 consensus_queue.cc:237] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09fdfef97e340beaa7093730bdeb8b3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46871 } }
I20260923 14:40:59.858548 21558 sys_catalog.cc:564] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:40:59.859530 21565 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a09fdfef97e340beaa7093730bdeb8b3. Latest consensus state: current_term: 1 leader_uuid: "a09fdfef97e340beaa7093730bdeb8b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09fdfef97e340beaa7093730bdeb8b3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46871 } } }
I20260923 14:40:59.859659 21565 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:59.859989 21564 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a09fdfef97e340beaa7093730bdeb8b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09fdfef97e340beaa7093730bdeb8b3" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46871 } } }
I20260923 14:40:59.860064 21564 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3 [sys.catalog]: This master's current role is: LEADER
I20260923 14:40:59.860383 21572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:40:59.861579 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:40:59.847926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39876 (local address 127.17.4.190:46871)
0923 14:40:59.848264 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0923 14:40:59.848280 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:40:59.848310 (+ 30us) server_negotiation.cc:407] Connection header received
0923 14:40:59.848882 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:40:59.848897 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:40:59.849239 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:40:59.849522 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:40:59.850169 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:59.851530 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:59.852379 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:40:59.853009 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:40:59.853199 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:40:59.855626 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:40:59.855634 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:40:59.855647 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:40:59.855675 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:40:59.857439 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:59.857970 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:59.857975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:59.857980 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:59.858103 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:40:59.858410 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:40:59.858413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:40:59.858415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:40:59.858902 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:40:59.859821 (+ 919us) server_negotiation.cc:1035] Waiting for connection context
0923 14:40:59.859959 (+ 138us) server_negotiation.cc:299] Negotiation successful
0923 14:40:59.860293 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":113,"threads_started":1}
I20260923 14:40:59.863543 21572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:40:59.868760 21572 catalog_manager.cc:1347] Generated new cluster ID: 4507274f7e3d4cd3afd5ee8f39f7c156
I20260923 14:40:59.868817 21572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:40:59.885357 21572 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:40:59.886119 21572 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:40:59.894568 21572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3: Generated new TSK 0
I20260923 14:40:59.895241 21572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:40:59.922582 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:46871
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:37689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:00.052173 21584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:00.052394 21584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:00.052436 21584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:00.056160 21584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:00.056201 21584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:00.056255 21584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:00.061345 21584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:37689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:46871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:00.062237 21584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:00.063136 21584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:00.072240 21584 server_base.cc:1034] running on GCE node
W20260923 14:41:00.072288 21590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.072257 21589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.072506 21592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:00.072918 21584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:00.073483 21584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:00.074641 21584 hybrid_clock.cc:648] HybridClock initialized: now 1790174460074557 us; error 95 us; skew 500 ppm
Sep 23 14:41:00 dist-test-slave-54kg krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:00.077297 21584 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:41:00.078012 21584 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:00.078071 21584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:00.078317 21584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:00.080291 21584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "3222de114bf64ac2afa34a118be72733"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "50e533adfe0850983d7a05b525fe56f1"
server_key_iv: "dc1a5e118876439d8f73aee1495f2a4b"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.080816 21584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "3222de114bf64ac2afa34a118be72733"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "50e533adfe0850983d7a05b525fe56f1"
server_key_iv: "dc1a5e118876439d8f73aee1495f2a4b"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.084129 21584 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:41:00.086263 21598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.087489 21584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:00.087653 21584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "3222de114bf64ac2afa34a118be72733"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "50e533adfe0850983d7a05b525fe56f1"
server_key_iv: "dc1a5e118876439d8f73aee1495f2a4b"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.087769 21584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:00.098067 21584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:00.100910 21584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:00.101099 21584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:00.101632 21584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:00.102396 21584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:00.102463 21584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.102530 21584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:00.102587 21584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.110953 21584 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:37411
I20260923 14:41:00.110970 21711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:37411 every 8 connection(s)
I20260923 14:41:00.111490 21584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:00.118963 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21584
I20260923 14:41:00.119087 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:00.119601 17426 external_mini_cluster.cc:1428] Setting key 7acf1987d4227ab217502f9f0fd47cdb
Sep 23 14:41:00 dist-test-slave-54kg krb5kdc[21478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:00.124512 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.113191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:50275 (local address 127.17.4.190:46871)
0923 14:41:00.113325 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.113329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.114442 (+ 1113us) server_negotiation.cc:407] Connection header received
0923 14:41:00.115336 (+ 894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.115339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.115397 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.115491 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:00.116678 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.117219 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.118349 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.118592 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.118713 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.121129 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:00.121132 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:00.121134 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:00.121167 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:00.122472 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.122975 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.122978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.122980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.123059 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.123389 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.123393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.123395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.123565 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:00.123674 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.124290 (+ 616us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.124400 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:41:00.125613 21714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.113525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46871 (local address 127.17.4.129:50275)
0923 14:41:00.114296 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.114334 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.115126 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.115684 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.115690 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.116091 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:00.116535 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.116549 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.117341 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.117345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.118216 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.118225 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.118779 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.118784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.118928 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.119447 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:00.119479 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:00.120973 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:00.122602 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:00.122608 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:00.122621 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:00.122862 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:00.123154 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:00.123159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:00.123161 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:00.123295 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:00.123669 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:00.123674 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:00.124025 (+ 351us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.124224 (+ 199us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.124554 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":124,"threads_started":1}
I20260923 14:41:00.126845 21712 heartbeater.cc:347] Connected to a master server at 127.17.4.190:46871
I20260923 14:41:00.127100 21712 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:00.127506 21712 heartbeater.cc:511] Master 127.17.4.190:46871 requested a full tablet report, sending...
I20260923 14:41:00.129011 21522 ts_manager.cc:194] Registered new tserver with Master: 3222de114bf64ac2afa34a118be72733 (127.17.4.129:37411)
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:41:00.130115 21522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:50275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:41:00.147055 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:46871
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:37689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:00.253898 21717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:00.254151 21717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:00.254204 21717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:00.258196 21717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:00.258250 21717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:00.258311 21717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:00.263844 21717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:37689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:46871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:00.264868 21717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:00.265849 21717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:00.275166 21723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.275172 21722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.275182 21725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:00.275378 21717 server_base.cc:1034] running on GCE node
I20260923 14:41:00.275872 21717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:00.276458 21717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:00.277640 21717 hybrid_clock.cc:648] HybridClock initialized: now 1790174460277626 us; error 35 us; skew 500 ppm
Sep 23 14:41:00 dist-test-slave-54kg krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:00.280361 21717 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:41:00.281106 21717 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:00.281198 21717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:00.281424 21717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:00.283438 21717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "e0d6dff56d564e12a44828272444e3d1"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "f38264fcbf1513903fe116cb980cd4d6"
server_key_iv: "afdcaed567ce6b3d7c127357f6498139"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.284021 21717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "e0d6dff56d564e12a44828272444e3d1"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "f38264fcbf1513903fe116cb980cd4d6"
server_key_iv: "afdcaed567ce6b3d7c127357f6498139"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.287420 21717 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260923 14:41:00.289750 21731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.290957 21717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:00.291081 21717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "e0d6dff56d564e12a44828272444e3d1"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "f38264fcbf1513903fe116cb980cd4d6"
server_key_iv: "afdcaed567ce6b3d7c127357f6498139"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.291182 21717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:00.303725 21717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:00.306881 21717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:00.307073 21717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:00.307689 21717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:00.308539 21717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:00.308606 21717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.308681 21717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:00.308730 21717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.317447 21717 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:36337
I20260923 14:41:00.317463 21844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:36337 every 8 connection(s)
I20260923 14:41:00.318027 21717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:00.322906 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21717
I20260923 14:41:00.323033 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:00.323386 17426 external_mini_cluster.cc:1428] Setting key d9a84ed6953f39ba15cb3ce1b226fefc
Sep 23 14:41:00 dist-test-slave-54kg krb5kdc[21478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:00.332124 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.319664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:50749 (local address 127.17.4.190:46871)
0923 14:41:00.319882 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.319887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.321036 (+ 1149us) server_negotiation.cc:407] Connection header received
0923 14:41:00.321912 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.321915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.321968 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.322073 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:00.323455 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.324074 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.325517 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.325927 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.326049 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.328567 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:00.328570 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:00.328573 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:00.328599 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:00.330078 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.330596 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.330601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.330605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.330689 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.331032 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.331036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.331038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.331223 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:00.331329 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.331827 (+ 498us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.331950 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:41:00.333027 21847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.320117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46871 (local address 127.17.4.130:50749)
0923 14:41:00.320899 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.320937 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.321716 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.322236 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.322242 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.322573 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:00.323259 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.323281 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.324219 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.324222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.325396 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.325406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.326069 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.326071 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.326211 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.326877 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:00.326893 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:00.328401 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:00.330212 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:00.330218 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:00.330234 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:00.330489 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:00.330783 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:00.330787 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:00.330789 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:00.330938 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:00.331328 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:00.331336 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:00.331570 (+ 234us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.331766 (+ 196us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.332100 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":111,"threads_started":1}
I20260923 14:41:00.334156 21845 heartbeater.cc:347] Connected to a master server at 127.17.4.190:46871
I20260923 14:41:00.334399 21845 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:00.334939 21845 heartbeater.cc:511] Master 127.17.4.190:46871 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:41:00.336067 21522 ts_manager.cc:194] Registered new tserver with Master: e0d6dff56d564e12a44828272444e3d1 (127.17.4.130:36337)
I20260923 14:41:00.336680 21522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:50749
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:41:00.350160 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:46871
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:37689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:00.457077 21850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:00.457304 21850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:00.457343 21850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:00.461439 21850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:00.461491 21850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:00.461585 21850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:00.466568 21850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:37689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:46871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:00.467511 21850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:00.468515 21850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:00.477799 21850 server_base.cc:1034] running on GCE node
W20260923 14:41:00.477753 21856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.477771 21858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.477757 21855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:00.478379 21850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:00.478988 21850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:00.480145 21850 hybrid_clock.cc:648] HybridClock initialized: now 1790174460480114 us; error 43 us; skew 500 ppm
Sep 23 14:41:00 dist-test-slave-54kg krb5kdc[21478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:00.482856 21850 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:41:00.483512 21850 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:00.483603 21850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:00.483908 21850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:00.485813 21850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "cea9c2041630470db213153a8ae35aa6"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "0191b788556f8480b35671a09dcdbda7"
server_key_iv: "5d0e1f9dbdbce6b2fa3d02404cd9b8fd"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.486372 21850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "cea9c2041630470db213153a8ae35aa6"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "0191b788556f8480b35671a09dcdbda7"
server_key_iv: "5d0e1f9dbdbce6b2fa3d02404cd9b8fd"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.489765 21850 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:41:00.492169 21864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.493307 21850 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:00.493430 21850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "cea9c2041630470db213153a8ae35aa6"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "0191b788556f8480b35671a09dcdbda7"
server_key_iv: "5d0e1f9dbdbce6b2fa3d02404cd9b8fd"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.493531 21850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:00.510090 21850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:00.512745 21850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:00.512929 21850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:00.513447 21850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:00.514228 21850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:00.514298 21850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.514366 21850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:00.514412 21850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.523286 21850 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:38801
I20260923 14:41:00.523307 21977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:38801 every 8 connection(s)
I20260923 14:41:00.523890 21850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:00.525665 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 21850
I20260923 14:41:00.525789 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:00.526074 17426 external_mini_cluster.cc:1428] Setting key 2bbb9da27f45aeaa997c5b8ab7e7978d
Sep 23 14:41:00 dist-test-slave-54kg krb5kdc[21478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:00.537616 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.525607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:37663 (local address 127.17.4.190:46871)
0923 14:41:00.525768 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.525774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.527303 (+ 1529us) server_negotiation.cc:407] Connection header received
0923 14:41:00.528369 (+ 1066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.528372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.528423 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.528501 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:00.529650 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.530167 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.531259 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.531494 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.531612 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.534058 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:00.534062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:00.534064 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:00.534092 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:00.535517 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.536103 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.536110 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.536113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.536194 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.536533 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.536536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.536538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.536717 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:00.536824 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.537314 (+ 490us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.537426 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:41:00.538354 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.526081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46871 (local address 127.17.4.131:37663)
0923 14:41:00.527166 (+ 1085us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.527208 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.528176 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.528684 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.528691 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.529036 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:00.529509 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.529521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.530289 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.530299 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.531137 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.531146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.531640 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.531643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.531869 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.532490 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:00.532506 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:00.533895 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:00.535659 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:00.535664 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:00.535678 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:00.536001 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:00.536288 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:00.536292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:00.536294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:00.536433 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:00.536833 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:00.536842 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:00.537070 (+ 228us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.537255 (+ 185us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.537572 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":143,"threads_started":1}
I20260923 14:41:00.539429 21978 heartbeater.cc:347] Connected to a master server at 127.17.4.190:46871
I20260923 14:41:00.539656 21978 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:00.540123 21978 heartbeater.cc:511] Master 127.17.4.190:46871 requested a full tablet report, sending...
I20260923 14:41:00.541105 21521 ts_manager.cc:194] Registered new tserver with Master: cea9c2041630470db213153a8ae35aa6 (127.17.4.131:38801)
I20260923 14:41:00.541662 21521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:37663
I20260923 14:41:00.551638 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:41:00.561517 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.553632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39886 (local address 127.17.4.190:46871)
0923 14:41:00.553795 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.553801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.553949 (+ 148us) server_negotiation.cc:407] Connection header received
0923 14:41:00.554131 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.554134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.554215 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.554302 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:00.554990 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.555515 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.556441 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.556662 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.556770 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.558169 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:00.558172 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:00.558174 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:00.558196 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:00.560064 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.560507 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.560509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.560511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.560583 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:00.560807 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:00.560809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:00.560810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:00.561017 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:00.561117 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.561300 (+ 183us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.561388 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 14:41:00.564467 21521 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39886:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:00.567263 21521 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:00.580920 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.575711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:38801 (local address 127.0.0.1:37956)
0923 14:41:00.576201 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.576213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.576300 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.577183 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.577185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.577203 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:00.577286 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.577292 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.578589 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.578595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.579529 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.579537 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.580396 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.580399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.580506 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.580541 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.580645 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.580759 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":6,"thread_start_us":122,"threads_started":1}
I20260923 14:41:00.581064 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.574995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:36337 (local address 127.0.0.1:44946)
0923 14:41:00.575337 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.575385 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.575510 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.576592 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.576598 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.576619 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:00.577013 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.577023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.578077 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.578084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.579462 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.579472 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.580582 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.580586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.580689 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.580710 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.580772 (+ 62us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.580851 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":241,"thread_start_us":88,"threads_started":1}
I20260923 14:41:00.581065 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.575837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55302 (local address 127.17.4.129:37411)
0923 14:41:00.576215 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.576233 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.576258 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:41:00.576336 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.576345 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.576538 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.576801 (+ 263us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:00.577037 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.578240 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.579700 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.580475 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.580632 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.580765 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.580828 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.580920 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":102,"threads_started":1}
I20260923 14:41:00.581442 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.576118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37956 (local address 127.17.4.131:38801)
0923 14:41:00.576737 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.576750 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.576772 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:41:00.576846 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.576852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.577059 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.577217 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:00.577375 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.578462 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.579665 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.580274 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.580396 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.580542 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.581168 (+ 626us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.581271 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":90,"threads_started":1}
I20260923 14:41:00.581508 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.575380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37411 (local address 127.0.0.1:55302)
0923 14:41:00.575738 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.575750 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.575857 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.576709 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.576712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.576730 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:00.576910 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.576920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.578375 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.578378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.579581 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.579590 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.580584 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.580586 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.580718 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.580738 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.580790 (+ 52us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.580847 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":136,"thread_start_us":98,"threads_started":1}
I20260923 14:41:00.581651 21990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.575173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44946 (local address 127.17.4.130:36337)
0923 14:41:00.575574 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.575587 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.575612 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:41:00.575690 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.575697 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.576427 (+ 730us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.576602 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:00.577120 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.577953 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.579611 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.580445 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.580993 (+ 548us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.581382 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.581429 (+ 47us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.581514 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":112,"threads_started":1}
I20260923 14:41:00.584458 21646 tablet_service.cc:1467] Processing CreateTablet for tablet 0f97f0fcc2cc4184954142926d99da24 (DEFAULT_TABLE table=test-table [id=19890b96ebb7416cb632f7af1d641ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:00.584481 21912 tablet_service.cc:1467] Processing CreateTablet for tablet 0f97f0fcc2cc4184954142926d99da24 (DEFAULT_TABLE table=test-table [id=19890b96ebb7416cb632f7af1d641ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:00.584481 21779 tablet_service.cc:1467] Processing CreateTablet for tablet 0f97f0fcc2cc4184954142926d99da24 (DEFAULT_TABLE table=test-table [id=19890b96ebb7416cb632f7af1d641ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:00.585458 21646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f97f0fcc2cc4184954142926d99da24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:00.585472 21779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f97f0fcc2cc4184954142926d99da24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:00.585484 21912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f97f0fcc2cc4184954142926d99da24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:00.592108 21995 tablet_bootstrap.cc:492] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: Bootstrap starting.
I20260923 14:41:00.592952 21997 tablet_bootstrap.cc:492] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Bootstrap starting.
I20260923 14:41:00.594488 21995 tablet_bootstrap.cc:654] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:00.595067 21997 tablet_bootstrap.cc:654] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:00.595854 21995 log.cc:824] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:00.596179 21996 tablet_bootstrap.cc:492] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Bootstrap starting.
I20260923 14:41:00.596230 21997 log.cc:824] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:00.598160 21995 tablet_bootstrap.cc:492] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: No bootstrap required, opened a new log
I20260923 14:41:00.598162 21997 tablet_bootstrap.cc:492] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: No bootstrap required, opened a new log
I20260923 14:41:00.598371 21997 ts_tablet_manager.cc:1397] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:41:00.598367 21995 ts_tablet_manager.cc:1397] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:41:00.598868 21996 tablet_bootstrap.cc:654] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:00.599714 21996 log.cc:824] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:00.601570 21997 raft_consensus.cc:348] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.601833 21997 raft_consensus.cc:374] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:00.601903 21996 tablet_bootstrap.cc:492] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: No bootstrap required, opened a new log
I20260923 14:41:00.601905 21997 raft_consensus.cc:729] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cea9c2041630470db213153a8ae35aa6, State: Initialized, Role: FOLLOWER
I20260923 14:41:00.602111 21996 ts_tablet_manager.cc:1397] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:41:00.602231 21995 raft_consensus.cc:348] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.602367 21997 consensus_queue.cc:260] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.602479 21995 raft_consensus.cc:374] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:00.602560 21995 raft_consensus.cc:729] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3222de114bf64ac2afa34a118be72733, State: Initialized, Role: FOLLOWER
I20260923 14:41:00.602980 21995 consensus_queue.cc:260] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.603344 21997 ts_tablet_manager.cc:1428] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:41:00.603696 21978 heartbeater.cc:503] Master 127.17.4.190:46871 was elected leader, sending a full tablet report...
I20260923 14:41:00.603946 21995 ts_tablet_manager.cc:1428] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 14:41:00.604414 21712 heartbeater.cc:503] Master 127.17.4.190:46871 was elected leader, sending a full tablet report...
I20260923 14:41:00.606021 21996 raft_consensus.cc:348] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.606325 21996 raft_consensus.cc:374] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:00.606428 21996 raft_consensus.cc:729] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d6dff56d564e12a44828272444e3d1, State: Initialized, Role: FOLLOWER
I20260923 14:41:00.606918 21996 consensus_queue.cc:260] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.607570 21845 heartbeater.cc:503] Master 127.17.4.190:46871 was elected leader, sending a full tablet report...
I20260923 14:41:00.608923 21996 ts_tablet_manager.cc:1428] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260923 14:41:00.612521 21713 tablet.cc:2369] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:00.722435 22003 raft_consensus.cc:482] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:00.722649 22003 raft_consensus.cc:504] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.724048 22003 leader_election.cc:288] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cea9c2041630470db213153a8ae35aa6 (127.17.4.131:38801), 3222de114bf64ac2afa34a118be72733 (127.17.4.129:37411)
I20260923 14:41:00.728147 21847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.724311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37411 (local address 127.17.4.130:40425)
0923 14:41:00.724444 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.724460 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.724551 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.724912 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.724916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.724934 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:00.725063 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.725071 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.726046 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.726049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.727125 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.727135 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.727830 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.727833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.727911 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.727931 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.727989 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.728044 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 14:41:00.728222 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.724535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:40425 (local address 127.17.4.129:37411)
0923 14:41:00.724686 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.724691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.724706 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:41:00.724751 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.724753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.724793 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.724899 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:00.725208 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.725944 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.727256 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.727672 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.727823 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.727888 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.728027 (+ 139us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.728101 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 14:41:00.728801 21666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f97f0fcc2cc4184954142926d99da24" candidate_uuid: "e0d6dff56d564e12a44828272444e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3222de114bf64ac2afa34a118be72733" is_pre_election: true
I20260923 14:41:00.728850 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.724508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:57531 (local address 127.17.4.131:38801)
0923 14:41:00.724646 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.724651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.725153 (+ 502us) server_negotiation.cc:407] Connection header received
0923 14:41:00.725389 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.725393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.725449 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.725526 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:00.725890 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.726460 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.727675 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.728263 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.728379 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.728428 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.728677 (+ 249us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.728745 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:41:00.728865 22004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.724311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:38801 (local address 127.17.4.130:57531)
0923 14:41:00.725035 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.725075 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:00.725260 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:00.725571 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:00.725573 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:00.725588 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:00.725704 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.725708 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.726578 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.726581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.727558 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:00.727565 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.728457 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.728460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:00.728557 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.728573 (+ 16us) client_negotiation.cc:769] Sending connection context
0923 14:41:00.728659 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:41:00.728730 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":347,"thread_start_us":115,"threads_started":1}
I20260923 14:41:00.729147 21666 raft_consensus.cc:2454] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d6dff56d564e12a44828272444e3d1 in term 0.
I20260923 14:41:00.729449 21932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f97f0fcc2cc4184954142926d99da24" candidate_uuid: "e0d6dff56d564e12a44828272444e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cea9c2041630470db213153a8ae35aa6" is_pre_election: true
I20260923 14:41:00.729663 21733 leader_election.cc:302] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3222de114bf64ac2afa34a118be72733, e0d6dff56d564e12a44828272444e3d1; no voters:
I20260923 14:41:00.729750 21932 raft_consensus.cc:2454] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0d6dff56d564e12a44828272444e3d1 in term 0.
I20260923 14:41:00.729943 22003 raft_consensus.cc:2781] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:00.730041 22003 raft_consensus.cc:482] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:00.730096 22003 raft_consensus.cc:3037] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:00.731163 22003 raft_consensus.cc:504] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.731513 22003 leader_election.cc:288] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [CANDIDATE]: Term 1 election: Requested vote from peers cea9c2041630470db213153a8ae35aa6 (127.17.4.131:38801), 3222de114bf64ac2afa34a118be72733 (127.17.4.129:37411)
I20260923 14:41:00.731889 21932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f97f0fcc2cc4184954142926d99da24" candidate_uuid: "e0d6dff56d564e12a44828272444e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cea9c2041630470db213153a8ae35aa6"
I20260923 14:41:00.731930 21666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f97f0fcc2cc4184954142926d99da24" candidate_uuid: "e0d6dff56d564e12a44828272444e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3222de114bf64ac2afa34a118be72733"
I20260923 14:41:00.732033 21932 raft_consensus.cc:3037] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:00.732059 21666 raft_consensus.cc:3037] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:00.733067 21666 raft_consensus.cc:2454] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d6dff56d564e12a44828272444e3d1 in term 1.
I20260923 14:41:00.733062 21932 raft_consensus.cc:2454] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0d6dff56d564e12a44828272444e3d1 in term 1.
I20260923 14:41:00.733402 21734 leader_election.cc:302] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cea9c2041630470db213153a8ae35aa6, e0d6dff56d564e12a44828272444e3d1; no voters:
I20260923 14:41:00.733624 22003 raft_consensus.cc:2781] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:00.733877 22003 raft_consensus.cc:686] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 1 LEADER]: Becoming Leader. State: Replica: e0d6dff56d564e12a44828272444e3d1, State: Running, Role: LEADER
I20260923 14:41:00.734232 22003 consensus_queue.cc:237] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } }
I20260923 14:41:00.737322 21522 catalog_manager.cc:5495] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0d6dff56d564e12a44828272444e3d1 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "e0d6dff56d564e12a44828272444e3d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0d6dff56d564e12a44828272444e3d1" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 } health_report { overall_health: UNKNOWN } } }
I20260923 14:41:00.769920 21990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.766402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44952 (local address 127.17.4.130:36337)
0923 14:41:00.766535 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:00.766539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:00.766551 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:00.766623 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:00.766625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:00.766682 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:00.766770 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:00.767030 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.767886 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.768698 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:00.768893 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:00.768963 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:00.769220 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:00.769618 (+ 398us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:00.769706 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:00.769763 (+ 57us) server_negotiation.cc:299] Negotiation successful
0923 14:41:00.769812 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 14:41:00.774803 21979 tablet.cc:2369] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:00.775745 21666 raft_consensus.cc:1261] T 0f97f0fcc2cc4184954142926d99da24 P 3222de114bf64ac2afa34a118be72733 [term 1 FOLLOWER]: Refusing update from remote peer e0d6dff56d564e12a44828272444e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:00.775743 21932 raft_consensus.cc:1261] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 1 FOLLOWER]: Refusing update from remote peer e0d6dff56d564e12a44828272444e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:00.776512 22003 consensus_queue.cc:1035] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3222de114bf64ac2afa34a118be72733" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:00.776762 22005 consensus_queue.cc:1035] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cea9c2041630470db213153a8ae35aa6" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:00.785404 22008 mvcc.cc:205] Tried to move back new op lower bound from 7332554591330299904 to 7332554591169945600. Current Snapshot: MvccSnapshot[applied={T|T < 7332554591330299904}]
I20260923 14:41:00.794297 21519 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:00.794461 21519 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:00.796749 21519 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a09fdfef97e340beaa7093730bdeb8b3: Sending DeleteTablet for 3 replicas of tablet 0f97f0fcc2cc4184954142926d99da24
I20260923 14:41:00.797565 21646 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f97f0fcc2cc4184954142926d99da24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:00 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:55302
I20260923 14:41:00.797556 21779 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f97f0fcc2cc4184954142926d99da24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:00 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:44946
I20260923 14:41:00.798075 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21584
I20260923 14:41:00.798072 22018 tablet_replica.cc:330] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: stopping tablet replica
I20260923 14:41:00.798220 21912 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f97f0fcc2cc4184954142926d99da24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:00 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:37956
I20260923 14:41:00.798398 22018 raft_consensus.cc:2229] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:00.798818 22018 raft_consensus.cc:2258] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:00.799196 22020 tablet_replica.cc:330] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: stopping tablet replica
I20260923 14:41:00.799566 22020 raft_consensus.cc:2229] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:00.800141 22020 raft_consensus.cc:2258] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:00.800505 22018 ts_tablet_manager.cc:1905] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:00.801546 22020 ts_tablet_manager.cc:1905] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:00.803244 22018 ts_tablet_manager.cc:1918] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:00.803407 22018 log.cc:1196] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/0f97f0fcc2cc4184954142926d99da24
I20260923 14:41:00.803812 22018 ts_tablet_manager.cc:1939] T 0f97f0fcc2cc4184954142926d99da24 P e0d6dff56d564e12a44828272444e3d1: Deleting consensus metadata
I20260923 14:41:00.804350 22020 ts_tablet_manager.cc:1918] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:00.804505 22020 log.cc:1196] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/0f97f0fcc2cc4184954142926d99da24
I20260923 14:41:00.804864 22020 ts_tablet_manager.cc:1939] T 0f97f0fcc2cc4184954142926d99da24 P cea9c2041630470db213153a8ae35aa6: Deleting consensus metadata
I20260923 14:41:00.805172 21508 catalog_manager.cc:4841] TS e0d6dff56d564e12a44828272444e3d1 (127.17.4.130:36337): tablet 0f97f0fcc2cc4184954142926d99da24 (table test-table [id=19890b96ebb7416cb632f7af1d641ba7]) successfully deleted
I20260923 14:41:00.805995 21508 catalog_manager.cc:4841] TS cea9c2041630470db213153a8ae35aa6 (127.17.4.131:38801): tablet 0f97f0fcc2cc4184954142926d99da24 (table test-table [id=19890b96ebb7416cb632f7af1d641ba7]) successfully deleted
W20260923 14:41:00.808187 21507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:37411 (error 108)
I20260923 14:41:00.808409 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21717
I20260923 14:41:00.810072 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:00.809788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37411 (local address 127.0.0.1:55306)
0923 14:41:00.809925 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:00.809999 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 14:41:00.810335 21507 catalog_manager.cc:4584] TS 3222de114bf64ac2afa34a118be72733 (127.17.4.129:37411): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0f97f0fcc2cc4184954142926d99da24: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37411: connect: Connection refused (error 111)
I20260923 14:41:00.813868 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21850
I20260923 14:41:00.819100 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 21491
2026-09-23T14:41:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2300 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-23T14:41:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:00Z Disabled control of system clock
I20260923 14:41:00.848513 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34217
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:34217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 14:41:00.955058 22025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:00.955308 22025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:00.955343 22025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:00.959372 22025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:00.959424 22025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:00.959440 22025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:00.959456 22025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:00.959471 22025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:00.964190 22025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:34217
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:00.965191 22025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:00.966495 22025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:00.974838 22033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.974881 22031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:00.974845 22030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:00.975044 22025 server_base.cc:1034] running on GCE node
I20260923 14:41:00.975745 22025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:00.976892 22025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:00.978075 22025 hybrid_clock.cc:648] HybridClock initialized: now 1790174460978061 us; error 29 us; skew 500 ppm
I20260923 14:41:00.979929 22025 webserver.cc:460] Webserver started at http://127.17.4.190:35409/ using document root <none> and password file <none>
I20260923 14:41:00.980491 22025 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:00.980579 22025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:00.980800 22025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:00.982784 22025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "fc1b5455da874eb7bb8ad5404f55de27"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "0a52e47c1ea34b775498ba7c4ce09cb4"
server_key_iv: "74cd9e0f3c14b6341b26044dc0c796fb"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.983386 22025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "fc1b5455da874eb7bb8ad5404f55de27"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "0a52e47c1ea34b775498ba7c4ce09cb4"
server_key_iv: "74cd9e0f3c14b6341b26044dc0c796fb"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.986909 22025 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:41:00.989322 22039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:00.990454 22025 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:00.990588 22025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "fc1b5455da874eb7bb8ad5404f55de27"
format_stamp: "Formatted at 2026-09-23 14:41:00 on dist-test-slave-54kg"
server_key: "0a52e47c1ea34b775498ba7c4ce09cb4"
server_key_iv: "74cd9e0f3c14b6341b26044dc0c796fb"
server_key_version: "encryptionkey@0"
I20260923 14:41:00.990700 22025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:00.995223 22025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:00.995859 22025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:00.996031 22025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:01.002345 22025 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:34217
I20260923 14:41:01.002389 22091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:34217 every 8 connection(s)
I20260923 14:41:01.003293 22025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:01.006366 22092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:01.011809 22092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27: Bootstrap starting.
I20260923 14:41:01.013509 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22025
I20260923 14:41:01.013655 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:01.013936 17426 external_mini_cluster.cc:1428] Setting key 2078ce563489615d7eb2905666cab69e
I20260923 14:41:01.014439 22092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:01.015276 22092 log.cc:824] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:01.017414 22092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27: No bootstrap required, opened a new log
I20260923 14:41:01.019284 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.015094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44816 (local address 127.17.4.190:34217)
0923 14:41:01.015806 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.015825 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.015865 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:41:01.016562 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.016580 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.016858 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.017127 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.018029 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.018034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.018045 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.018055 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.018109 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.018125 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.018216 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.018345 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.018595 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":157,"threads_started":1}
I20260923 14:41:01.021637 22092 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1b5455da874eb7bb8ad5404f55de27" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34217 } }
I20260923 14:41:01.021869 22092 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:01.021955 22092 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1b5455da874eb7bb8ad5404f55de27, State: Initialized, Role: FOLLOWER
I20260923 14:41:01.022406 22092 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1b5455da874eb7bb8ad5404f55de27" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34217 } }
I20260923 14:41:01.022557 22092 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:01.022660 22092 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:01.022768 22092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:01.023648 22092 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1b5455da874eb7bb8ad5404f55de27" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34217 } }
I20260923 14:41:01.024011 22092 leader_election.cc:302] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc1b5455da874eb7bb8ad5404f55de27; no voters:
I20260923 14:41:01.024312 22092 leader_election.cc:288] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:01.024417 22097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:01.024628 22097 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [term 1 LEADER]: Becoming Leader. State: Replica: fc1b5455da874eb7bb8ad5404f55de27, State: Running, Role: LEADER
I20260923 14:41:01.024920 22097 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1b5455da874eb7bb8ad5404f55de27" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34217 } }
I20260923 14:41:01.025481 22092 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:01.026599 22098 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc1b5455da874eb7bb8ad5404f55de27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1b5455da874eb7bb8ad5404f55de27" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34217 } } }
I20260923 14:41:01.026721 22098 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:01.027000 22099 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc1b5455da874eb7bb8ad5404f55de27. Latest consensus state: current_term: 1 leader_uuid: "fc1b5455da874eb7bb8ad5404f55de27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc1b5455da874eb7bb8ad5404f55de27" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34217 } } }
I20260923 14:41:01.027096 22099 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:01.027210 22106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:01.029800 22106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:01.034763 22106 catalog_manager.cc:1347] Generated new cluster ID: 265a9952482d416d91d48977b83287ce
I20260923 14:41:01.034828 22106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:01.062950 22106 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:01.063320 22106 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:01.069952 22106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27: Generated new TSK 0
I20260923 14:41:01.070621 22106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:41:01.078088 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34217
--builtin_ntp_servers=127.17.4.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 14:41:01.187127 22116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:01.187376 22116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:01.187412 22116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:01.191388 22116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:01.191435 22116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:01.191489 22116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:01.196455 22116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:01.197458 22116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:01.198818 22116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:01.207996 22121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:01.208103 22124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:01.208140 22122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:01.208335 22116 server_base.cc:1034] running on GCE node
I20260923 14:41:01.208742 22116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:01.209316 22116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:01.210500 22116 hybrid_clock.cc:648] HybridClock initialized: now 1790174461210490 us; error 30 us; skew 500 ppm
I20260923 14:41:01.212234 22116 webserver.cc:460] Webserver started at http://127.17.4.129:44625/ using document root <none> and password file <none>
I20260923 14:41:01.212776 22116 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:01.212864 22116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:01.213068 22116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:01.215042 22116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "643bc351cae44d84aadd51bcf140a138"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "4f861e5fa453b28c64b928c14d423e4c"
server_key_iv: "244803e1c3ca85a159a612a45ee78cfb"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.215580 22116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "643bc351cae44d84aadd51bcf140a138"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "4f861e5fa453b28c64b928c14d423e4c"
server_key_iv: "244803e1c3ca85a159a612a45ee78cfb"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.219048 22116 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:41:01.221411 22130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.222537 22116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:01.222661 22116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "643bc351cae44d84aadd51bcf140a138"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "4f861e5fa453b28c64b928c14d423e4c"
server_key_iv: "244803e1c3ca85a159a612a45ee78cfb"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.222766 22116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:01.227481 22116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:01.228099 22116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:01.228278 22116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:01.228770 22116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:01.229594 22116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:01.229686 22116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.229744 22116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:01.229773 22116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.238023 22116 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:46575
I20260923 14:41:01.238044 22243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:46575 every 8 connection(s)
I20260923 14:41:01.238854 22116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:01.244014 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22116
I20260923 14:41:01.244146 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:01.244445 17426 external_mini_cluster.cc:1428] Setting key 65ac34758e7998a64e9302eb67681466
I20260923 14:41:01.244984 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.240681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:54509 (local address 127.17.4.190:34217)
0923 14:41:01.240843 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.240847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.241884 (+ 1037us) server_negotiation.cc:407] Connection header received
0923 14:41:01.243221 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.243224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.243271 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.243341 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.244551 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.244555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.244557 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.244571 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.244596 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.244606 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.244705 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.244831 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.244883 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:41:01.245975 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.241069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34217 (local address 127.17.4.129:54509)
0923 14:41:01.241726 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.241782 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.243042 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.243490 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.243496 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.243579 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.244268 (+ 689us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.244272 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.244323 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.244401 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.244696 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.244703 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.244707 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.244839 (+ 132us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.245103 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":107,"threads_started":1}
I20260923 14:41:01.246544 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34217
--builtin_ntp_servers=127.17.4.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 14:41:01.247277 22244 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34217
I20260923 14:41:01.247500 22244 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:01.247980 22244 heartbeater.cc:511] Master 127.17.4.190:34217 requested a full tablet report, sending...
I20260923 14:41:01.249392 22056 ts_manager.cc:194] Registered new tserver with Master: 643bc351cae44d84aadd51bcf140a138 (127.17.4.129:46575)
W20260923 14:41:01.354614 22247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:01.354841 22247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:01.354878 22247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:01.358819 22247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:01.358860 22247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:01.358944 22247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:01.363626 22247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:01.364581 22247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:01.365818 22247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:01.374970 22252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:01.375079 22247 server_base.cc:1034] running on GCE node
W20260923 14:41:01.374984 22253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:01.374996 22255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:01.375720 22247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:01.376353 22247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:01.377506 22247 hybrid_clock.cc:648] HybridClock initialized: now 1790174461377494 us; error 31 us; skew 500 ppm
I20260923 14:41:01.379189 22247 webserver.cc:460] Webserver started at http://127.17.4.130:42075/ using document root <none> and password file <none>
I20260923 14:41:01.379730 22247 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:01.379854 22247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:01.380077 22247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:01.382011 22247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "ca860622a4d54ce89dcc8fdbac1789f6"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "1ecc7afee81f87a339d947f4818807fa"
server_key_iv: "2d0ded453d79db96320c7e85111d5ed8"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.382606 22247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "ca860622a4d54ce89dcc8fdbac1789f6"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "1ecc7afee81f87a339d947f4818807fa"
server_key_iv: "2d0ded453d79db96320c7e85111d5ed8"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.386030 22247 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 14:41:01.388335 22261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.389482 22247 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:41:01.389598 22247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "ca860622a4d54ce89dcc8fdbac1789f6"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "1ecc7afee81f87a339d947f4818807fa"
server_key_iv: "2d0ded453d79db96320c7e85111d5ed8"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.389698 22247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:01.394264 22247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:01.394814 22247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:01.394994 22247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:01.395540 22247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:01.396430 22247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:01.396476 22247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.396541 22247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:01.396576 22247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.405014 22247 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:34349
I20260923 14:41:01.405038 22374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:34349 every 8 connection(s)
I20260923 14:41:01.405848 22247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:01.411548 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.407576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:43873 (local address 127.17.4.190:34217)
0923 14:41:01.407732 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.407736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.408804 (+ 1068us) server_negotiation.cc:407] Connection header received
0923 14:41:01.410042 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.410045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.410080 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.410142 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.411173 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.411176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.411178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.411189 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.411208 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.411216 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.411289 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.411406 (+ 117us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.411442 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 14:41:01.412429 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.408018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34217 (local address 127.17.4.130:43873)
0923 14:41:01.408663 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.408701 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.409848 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.410302 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.410308 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.410392 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.410920 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.410922 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.410960 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.411025 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.411291 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.411297 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.411301 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.411427 (+ 126us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.411622 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":107,"threads_started":1}
I20260923 14:41:01.412737 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22247
I20260923 14:41:01.412854 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:01.413185 17426 external_mini_cluster.cc:1428] Setting key 34e650d4c235ad8913f36ddeaba22dd0
I20260923 14:41:01.413594 22375 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34217
I20260923 14:41:01.413815 22375 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:01.414217 22375 heartbeater.cc:511] Master 127.17.4.190:34217 requested a full tablet report, sending...
I20260923 14:41:01.415086 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34217
--builtin_ntp_servers=127.17.4.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 14:41:01.415221 22056 ts_manager.cc:194] Registered new tserver with Master: ca860622a4d54ce89dcc8fdbac1789f6 (127.17.4.130:34349)
W20260923 14:41:01.523319 22378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:01.523591 22378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:01.523633 22378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:01.528059 22378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:01.528115 22378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:01.528170 22378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:01.533051 22378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:01.534044 22378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:01.535328 22378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:01.544500 22383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:01.544514 22384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:01.544695 22378 server_base.cc:1034] running on GCE node
W20260923 14:41:01.544591 22386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:01.545231 22378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:01.545827 22378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:01.546977 22378 hybrid_clock.cc:648] HybridClock initialized: now 1790174461546944 us; error 45 us; skew 500 ppm
I20260923 14:41:01.548741 22378 webserver.cc:460] Webserver started at http://127.17.4.131:40409/ using document root <none> and password file <none>
I20260923 14:41:01.549291 22378 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:01.549352 22378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:01.549584 22378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:01.552244 22378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "aa6b423d248d458eaf2f1bf91690de79"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "1fe5ab15ea37dadd43c2d5710e6862a4"
server_key_iv: "5541e498ec0ec3bbecb0b990d0688227"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.552937 22378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "aa6b423d248d458eaf2f1bf91690de79"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "1fe5ab15ea37dadd43c2d5710e6862a4"
server_key_iv: "5541e498ec0ec3bbecb0b990d0688227"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.556546 22378 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260923 14:41:01.559010 22392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.560256 22378 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:41:01.560395 22378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "aa6b423d248d458eaf2f1bf91690de79"
format_stamp: "Formatted at 2026-09-23 14:41:01 on dist-test-slave-54kg"
server_key: "1fe5ab15ea37dadd43c2d5710e6862a4"
server_key_iv: "5541e498ec0ec3bbecb0b990d0688227"
server_key_version: "encryptionkey@0"
I20260923 14:41:01.560519 22378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:01.564865 22378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:01.565423 22378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:01.565587 22378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:01.566071 22378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:01.566892 22378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:01.566964 22378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.567025 22378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:01.567070 22378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:01.575748 22378 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:42087
I20260923 14:41:01.575809 22505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:42087 every 8 connection(s)
I20260923 14:41:01.576539 22378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:01.580890 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22378
I20260923 14:41:01.581003 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:01.581336 17426 external_mini_cluster.cc:1428] Setting key 35cf813fc01df0f769e8ff5b2442488e
I20260923 14:41:01.582481 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.578182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:52891 (local address 127.17.4.190:34217)
0923 14:41:01.578334 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.578339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.579298 (+ 959us) server_negotiation.cc:407] Connection header received
0923 14:41:01.580675 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.580677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.580713 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.580774 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.581953 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.581955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.581958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.581994 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.582033 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.582045 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.582136 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.582316 (+ 180us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.582359 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:41:01.583376 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.578574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34217 (local address 127.17.4.131:52891)
0923 14:41:01.579170 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.579207 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.580469 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.580953 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.580963 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.581080 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.581676 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.581678 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.581725 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.581790 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.582159 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.582171 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.582177 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.582369 (+ 192us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.582612 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":112,"threads_started":1}
I20260923 14:41:01.584348 22506 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34217
I20260923 14:41:01.584561 22506 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:01.584941 22506 heartbeater.cc:511] Master 127.17.4.190:34217 requested a full tablet report, sending...
I20260923 14:41:01.585875 22056 ts_manager.cc:194] Registered new tserver with Master: aa6b423d248d458eaf2f1bf91690de79 (127.17.4.131:42087)
I20260923 14:41:01.595095 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:41:01.598570 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.597056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44832 (local address 127.17.4.190:34217)
0923 14:41:01.597205 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.597209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.597412 (+ 203us) server_negotiation.cc:407] Connection header received
0923 14:41:01.597506 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.597508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.597553 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.597638 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.598277 (+ 639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.598280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.598282 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.598291 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.598309 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.598317 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.598383 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.598443 (+ 60us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.598474 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:41:01.601204 22056 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:01.604188 22056 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:01.615072 22520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.612267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:46575 (local address 127.0.0.1:36982)
0923 14:41:01.613141 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.613151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.613300 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.613687 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.613690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.613733 (+ 43us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.614348 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.614350 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.614369 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.614431 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.614762 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.614772 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.614779 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.614891 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.614958 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"thread_start_us":96,"threads_started":1}
I20260923 14:41:01.615506 22521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.612531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36982 (local address 127.17.4.129:46575)
0923 14:41:01.612953 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.612964 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.613245 (+ 281us) server_negotiation.cc:407] Connection header received
0923 14:41:01.613424 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.613429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.613576 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.613709 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.614571 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.614577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.614592 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.614608 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.614655 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.614687 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.614788 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.615269 (+ 481us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.615346 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":90,"threads_started":1}
I20260923 14:41:01.615785 22518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.611898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:42087 (local address 127.0.0.1:38968)
0923 14:41:01.612826 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.612877 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.612974 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.614538 (+ 1564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.614541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.614554 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.614989 (+ 435us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.614993 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.615005 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.615037 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.615481 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.615484 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.615488 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.615574 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.615610 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"spinlock_wait_cycles":13440,"thread_start_us":73,"threads_started":1}
I20260923 14:41:01.616021 22517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.611990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34349 (local address 127.0.0.1:53596)
0923 14:41:01.612826 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.612877 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.612974 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.613646 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.613654 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.613734 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.614461 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.614463 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.614471 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.614520 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.615783 (+ 1263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.615786 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.615790 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.615851 (+ 61us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.615893 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"spinlock_wait_cycles":2688,"thread_start_us":78,"threads_started":1}
I20260923 14:41:01.616590 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.612006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.17.4.131:42087)
0923 14:41:01.613543 (+ 1537us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.613557 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.613578 (+ 21us) server_negotiation.cc:407] Connection header received
0923 14:41:01.613628 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.613633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.613816 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.613956 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.615285 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.615290 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.615301 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.615313 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.615354 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.615384 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.615487 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.616390 (+ 903us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.616461 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1442,"thread_start_us":133,"threads_started":1}
I20260923 14:41:01.616766 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.612679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53596 (local address 127.17.4.130:34349)
0923 14:41:01.613161 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.613174 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.613203 (+ 29us) server_negotiation.cc:407] Connection header received
0923 14:41:01.613264 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.613268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.613458 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.614673 (+ 1215us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.615473 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.615478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.615488 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.615499 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.615540 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.615567 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.616507 (+ 940us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.616552 (+ 45us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.616627 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":130,"threads_started":1}
I20260923 14:41:01.618312 22178 tablet_service.cc:1467] Processing CreateTablet for tablet dfdef04f44084bd693e90bc686fca44d (DEFAULT_TABLE table=test-table [id=289a2968fd944be690eeae3d6b2b771b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:01.619369 22178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdef04f44084bd693e90bc686fca44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:01.619109 22309 tablet_service.cc:1467] Processing CreateTablet for tablet dfdef04f44084bd693e90bc686fca44d (DEFAULT_TABLE table=test-table [id=289a2968fd944be690eeae3d6b2b771b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:01.619110 22440 tablet_service.cc:1467] Processing CreateTablet for tablet dfdef04f44084bd693e90bc686fca44d (DEFAULT_TABLE table=test-table [id=289a2968fd944be690eeae3d6b2b771b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:01.620071 22309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdef04f44084bd693e90bc686fca44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:01.620071 22440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdef04f44084bd693e90bc686fca44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:01.625267 22523 tablet_bootstrap.cc:492] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: Bootstrap starting.
I20260923 14:41:01.627565 22525 tablet_bootstrap.cc:492] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Bootstrap starting.
I20260923 14:41:01.627601 22524 tablet_bootstrap.cc:492] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Bootstrap starting.
I20260923 14:41:01.628105 22523 tablet_bootstrap.cc:654] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:01.628868 22523 log.cc:824] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:01.629645 22525 tablet_bootstrap.cc:654] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:01.629645 22524 tablet_bootstrap.cc:654] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:01.630478 22524 log.cc:824] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:01.630478 22525 log.cc:824] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:01.630645 22523 tablet_bootstrap.cc:492] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: No bootstrap required, opened a new log
I20260923 14:41:01.630838 22523 ts_tablet_manager.cc:1397] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260923 14:41:01.632243 22524 tablet_bootstrap.cc:492] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: No bootstrap required, opened a new log
I20260923 14:41:01.632453 22524 ts_tablet_manager.cc:1397] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:41:01.632933 22525 tablet_bootstrap.cc:492] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: No bootstrap required, opened a new log
I20260923 14:41:01.633102 22525 ts_tablet_manager.cc:1397] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:41:01.634812 22523 raft_consensus.cc:348] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.635056 22523 raft_consensus.cc:374] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:01.635107 22523 raft_consensus.cc:729] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643bc351cae44d84aadd51bcf140a138, State: Initialized, Role: FOLLOWER
I20260923 14:41:01.635531 22523 consensus_queue.cc:260] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.636154 22244 heartbeater.cc:503] Master 127.17.4.190:34217 was elected leader, sending a full tablet report...
I20260923 14:41:01.636490 22523 ts_tablet_manager.cc:1428] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260923 14:41:01.636871 22524 raft_consensus.cc:348] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.637127 22524 raft_consensus.cc:374] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:01.637183 22524 raft_consensus.cc:729] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca860622a4d54ce89dcc8fdbac1789f6, State: Initialized, Role: FOLLOWER
I20260923 14:41:01.637318 22525 raft_consensus.cc:348] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.637568 22525 raft_consensus.cc:374] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:01.637655 22525 raft_consensus.cc:729] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6b423d248d458eaf2f1bf91690de79, State: Initialized, Role: FOLLOWER
I20260923 14:41:01.637609 22524 consensus_queue.cc:260] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.638055 22525 consensus_queue.cc:260] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.638521 22524 ts_tablet_manager.cc:1428] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:41:01.638739 22506 heartbeater.cc:503] Master 127.17.4.190:34217 was elected leader, sending a full tablet report...
I20260923 14:41:01.638970 22375 heartbeater.cc:503] Master 127.17.4.190:34217 was elected leader, sending a full tablet report...
I20260923 14:41:01.643523 22525 ts_tablet_manager.cc:1428] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
W20260923 14:41:01.656765 22376 tablet.cc:2369] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:41:01.739995 22245 tablet.cc:2369] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:01.778805 22531 raft_consensus.cc:482] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:01.779008 22531 raft_consensus.cc:504] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.780148 22531 leader_election.cc:288] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca860622a4d54ce89dcc8fdbac1789f6 (127.17.4.130:34349), 643bc351cae44d84aadd51bcf140a138 (127.17.4.129:46575)
I20260923 14:41:01.782222 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.780426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:46575 (local address 127.17.4.131:50919)
0923 14:41:01.780560 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.780577 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.780702 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.781042 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.781044 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.781056 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.781578 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.781581 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.781596 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.781628 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.781926 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.781931 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.781939 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.782031 (+ 92us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.782069 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 14:41:01.782259 22521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.780549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:50919 (local address 127.17.4.129:46575)
0923 14:41:01.780714 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.780719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.780736 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:41:01.780789 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.780792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.780833 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.780949 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.781762 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.781766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.781768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.781782 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.781808 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.781819 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.781919 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.782048 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.782086 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 14:41:01.782378 22532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.780426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34349 (local address 127.17.4.131:45065)
0923 14:41:01.780989 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.781001 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:01.781121 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:01.781384 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:01.781387 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:01.781401 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:01.781820 (+ 419us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:01.781822 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:01.781833 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:01.781862 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:01.782134 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:01.782138 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:01.782141 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 14:41:01.782215 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 14:41:01.782246 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":213,"thread_start_us":153,"threads_started":1}
I20260923 14:41:01.782383 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.780558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:45065 (local address 127.17.4.130:34349)
0923 14:41:01.780716 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.780721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.781082 (+ 361us) server_negotiation.cc:407] Connection header received
0923 14:41:01.781235 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.781238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.781280 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.781370 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.781989 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.781995 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.781999 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.782013 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.782034 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.782046 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.782129 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.782222 (+ 93us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.782264 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 14:41:01.782909 22198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdef04f44084bd693e90bc686fca44d" candidate_uuid: "aa6b423d248d458eaf2f1bf91690de79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bc351cae44d84aadd51bcf140a138" is_pre_election: true
I20260923 14:41:01.783123 22329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdef04f44084bd693e90bc686fca44d" candidate_uuid: "aa6b423d248d458eaf2f1bf91690de79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" is_pre_election: true
I20260923 14:41:01.783241 22198 raft_consensus.cc:2454] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b423d248d458eaf2f1bf91690de79 in term 0.
I20260923 14:41:01.783365 22329 raft_consensus.cc:2454] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b423d248d458eaf2f1bf91690de79 in term 0.
I20260923 14:41:01.783845 22396 leader_election.cc:302] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa6b423d248d458eaf2f1bf91690de79, ca860622a4d54ce89dcc8fdbac1789f6; no voters:
I20260923 14:41:01.784118 22531 raft_consensus.cc:2781] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:01.784209 22531 raft_consensus.cc:482] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:01.784252 22531 raft_consensus.cc:3037] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:01.785283 22531 raft_consensus.cc:504] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.785606 22531 leader_election.cc:288] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [CANDIDATE]: Term 1 election: Requested vote from peers ca860622a4d54ce89dcc8fdbac1789f6 (127.17.4.130:34349), 643bc351cae44d84aadd51bcf140a138 (127.17.4.129:46575)
I20260923 14:41:01.785918 22329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdef04f44084bd693e90bc686fca44d" candidate_uuid: "aa6b423d248d458eaf2f1bf91690de79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca860622a4d54ce89dcc8fdbac1789f6"
I20260923 14:41:01.785992 22198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdef04f44084bd693e90bc686fca44d" candidate_uuid: "aa6b423d248d458eaf2f1bf91690de79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bc351cae44d84aadd51bcf140a138"
I20260923 14:41:01.786028 22329 raft_consensus.cc:3037] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:01.786127 22198 raft_consensus.cc:3037] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:01.787051 22329 raft_consensus.cc:2454] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b423d248d458eaf2f1bf91690de79 in term 1.
I20260923 14:41:01.787205 22198 raft_consensus.cc:2454] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b423d248d458eaf2f1bf91690de79 in term 1.
I20260923 14:41:01.787355 22396 leader_election.cc:302] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa6b423d248d458eaf2f1bf91690de79, ca860622a4d54ce89dcc8fdbac1789f6; no voters:
I20260923 14:41:01.787556 22531 raft_consensus.cc:2781] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:01.787740 22531 raft_consensus.cc:686] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 1 LEADER]: Becoming Leader. State: Replica: aa6b423d248d458eaf2f1bf91690de79, State: Running, Role: LEADER
I20260923 14:41:01.788084 22531 consensus_queue.cc:237] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } }
I20260923 14:41:01.791057 22055 catalog_manager.cc:5495] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa6b423d248d458eaf2f1bf91690de79 (127.17.4.131). New cstate: current_term: 1 leader_uuid: "aa6b423d248d458eaf2f1bf91690de79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b423d248d458eaf2f1bf91690de79" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 } health_report { overall_health: UNKNOWN } } }
I20260923 14:41:01.803231 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.801759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.17.4.131:42087)
0923 14:41:01.801887 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:01.801891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:01.801904 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:01.802025 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:01.802028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:01.802089 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:01.802155 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:01.802836 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:01.802838 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:01.802840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:01.802848 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:01.802861 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:01.802868 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:01.802929 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:01.803016 (+ 87us) server_negotiation.cc:299] Negotiation successful
0923 14:41:01.803070 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 14:41:01.808724 22198 raft_consensus.cc:1261] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 1 FOLLOWER]: Refusing update from remote peer aa6b423d248d458eaf2f1bf91690de79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:01.808766 22329 raft_consensus.cc:1261] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 1 FOLLOWER]: Refusing update from remote peer aa6b423d248d458eaf2f1bf91690de79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:01.809422 22533 consensus_queue.cc:1035] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca860622a4d54ce89dcc8fdbac1789f6" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 34349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:01.809610 22531 consensus_queue.cc:1035] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bc351cae44d84aadd51bcf140a138" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:01.818444 22538 mvcc.cc:205] Tried to move back new op lower bound from 7332554595561611264 to 7332554595486609408. Current Snapshot: MvccSnapshot[applied={T|T < 7332554595561611264}]
I20260923 14:41:01.823856 22055 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:01.823997 22055 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:01.826329 22055 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc1b5455da874eb7bb8ad5404f55de27: Sending DeleteTablet for 3 replicas of tablet dfdef04f44084bd693e90bc686fca44d
I20260923 14:41:01.827046 22440 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdef04f44084bd693e90bc686fca44d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:01 UTC) from {username='slave'} at 127.0.0.1:38968
I20260923 14:41:01.827047 22309 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdef04f44084bd693e90bc686fca44d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:01 UTC) from {username='slave'} at 127.0.0.1:53596
I20260923 14:41:01.827283 22178 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdef04f44084bd693e90bc686fca44d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:01 UTC) from {username='slave'} at 127.0.0.1:36982
I20260923 14:41:01.827939 22547 tablet_replica.cc:330] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138: stopping tablet replica
I20260923 14:41:01.828236 22547 raft_consensus.cc:2229] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:01.828523 22545 tablet_replica.cc:330] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: stopping tablet replica
I20260923 14:41:01.828555 22547 raft_consensus.cc:2258] T dfdef04f44084bd693e90bc686fca44d P 643bc351cae44d84aadd51bcf140a138 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:01.828586 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22116
I20260923 14:41:01.829169 22546 tablet_replica.cc:330] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: stopping tablet replica
I20260923 14:41:01.829407 22546 raft_consensus.cc:2229] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:01.829643 22546 raft_consensus.cc:2258] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:01.829896 22545 raft_consensus.cc:2229] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:01.830205 22545 raft_consensus.cc:2258] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:01.831655 22545 ts_tablet_manager.cc:1905] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:01.832849 22546 ts_tablet_manager.cc:1905] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:01.834460 22545 ts_tablet_manager.cc:1918] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:01.834556 22545 log.cc:1196] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/dfdef04f44084bd693e90bc686fca44d
I20260923 14:41:01.834897 22545 ts_tablet_manager.cc:1939] T dfdef04f44084bd693e90bc686fca44d P aa6b423d248d458eaf2f1bf91690de79: Deleting consensus metadata
I20260923 14:41:01.836115 22041 catalog_manager.cc:4841] TS aa6b423d248d458eaf2f1bf91690de79 (127.17.4.131:42087): tablet dfdef04f44084bd693e90bc686fca44d (table test-table [id=289a2968fd944be690eeae3d6b2b771b]) successfully deleted
W20260923 14:41:01.836566 22042 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:46575 (error 108)
I20260923 14:41:01.836699 22546 ts_tablet_manager.cc:1918] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:01.836795 22546 log.cc:1196] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/dfdef04f44084bd693e90bc686fca44d
I20260923 14:41:01.837123 22546 ts_tablet_manager.cc:1939] T dfdef04f44084bd693e90bc686fca44d P ca860622a4d54ce89dcc8fdbac1789f6: Deleting consensus metadata
I20260923 14:41:01.837643 22517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.837328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:46575 (local address 127.0.0.1:36988)
0923 14:41:01.837465 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.837551 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:46575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 14:41:01.837704 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22247
W20260923 14:41:01.837884 22042 catalog_manager.cc:4584] TS 643bc351cae44d84aadd51bcf140a138 (127.17.4.129:46575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dfdef04f44084bd693e90bc686fca44d: Network error: Client connection negotiation failed: client connection to 127.17.4.129:46575: connect: Connection refused (error 111)
I20260923 14:41:01.843852 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22378
I20260923 14:41:01.844691 22517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:01.843930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:34349 (local address 127.0.0.1:53604)
0923 14:41:01.844523 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:01.844585 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.130:34349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498}
I20260923 14:41:01.849354 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22025
2026-09-23T14:41:01Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1027 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260923 14:41:01.869051 17426 mini_oidc.cc:152] Starting JWKS server
I20260923 14:41:01.870527 17426 webserver.cc:460] Webserver started at https://127.0.0.1:38335/ using document root <none> and password file <none>
I20260923 14:41:01.870662 17426 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 14:41:01.870854 17426 webserver.cc:460] Webserver started at http://127.0.0.1:46511/ using document root <none> and password file <none>
2026-09-23T14:41:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:01Z Disabled control of system clock
I20260923 14:41:01.879216 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36323
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:43511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:36323
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38335/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/testchainca.cert with env {}
W20260923 14:41:01.987444 22554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:01.987715 22554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:01.987753 22554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:01.991736 22554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:01.991808 22554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:01.991824 22554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:01.991844 22554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:01.991859 22554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 14:41:01.991875 22554 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 14:41:01.991889 22554 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38335/jwks.json
I20260923 14:41:01.997149 22554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:36323
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38335/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:01.998123 22554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:01.999047 22554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:02.007418 22562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:02.007426 22560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:02.007459 22554 server_base.cc:1034] running on GCE node
W20260923 14:41:02.007426 22559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:02.008276 22554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:02.009377 22554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:02.010566 22554 hybrid_clock.cc:648] HybridClock initialized: now 1790174462010551 us; error 29 us; skew 500 ppm
I20260923 14:41:02.012490 22554 webserver.cc:460] Webserver started at http://127.17.4.190:44999/ using document root <none> and password file <none>
I20260923 14:41:02.013080 22554 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:02.013145 22554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:02.013386 22554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:02.015424 22554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "8fa8cdbf41164c03a3989b0c3304ea6a"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "374f5ba91af97726f60015f7541ab672"
server_key_iv: "7212b020af220e1cf44fe7f71b6d7fa7"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.016029 22554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "8fa8cdbf41164c03a3989b0c3304ea6a"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "374f5ba91af97726f60015f7541ab672"
server_key_iv: "7212b020af220e1cf44fe7f71b6d7fa7"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.019544 22554 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:41:02.021978 22568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:02.023195 22554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:02.023315 22554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "8fa8cdbf41164c03a3989b0c3304ea6a"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "374f5ba91af97726f60015f7541ab672"
server_key_iv: "7212b020af220e1cf44fe7f71b6d7fa7"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.023414 22554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:02.033814 22554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:02.034423 22554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:02.034618 22554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:02.041189 22554 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:36323
I20260923 14:41:02.041209 22620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:36323 every 8 connection(s)
I20260923 14:41:02.042107 22554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:02.044348 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22554
I20260923 14:41:02.044473 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:02.044763 17426 external_mini_cluster.cc:1428] Setting key 1d65718330d35d0cdc2a3fdd7e309c58
I20260923 14:41:02.045480 22621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:02.051138 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a: Bootstrap starting.
I20260923 14:41:02.053356 22621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:02.053596 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.046115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.17.4.190:36323)
0923 14:41:02.046731 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.046747 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.046780 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:41:02.047413 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.047430 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.047868 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.048195 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:02.048613 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.049536 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.050417 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.050879 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.051058 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.051945 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:02.051950 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:02.051962 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:02.052334 (+ 372us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:02.052385 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:02.052403 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:02.052511 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:02.052633 (+ 122us) server_negotiation.cc:299] Negotiation successful
0923 14:41:02.052875 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":124,"threads_started":1}
I20260923 14:41:02.054128 22621 log.cc:824] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:02.056281 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a: No bootstrap required, opened a new log
I20260923 14:41:02.056391 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:41:02.060015 22621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36323 } }
I20260923 14:41:02.060261 22621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:02.060343 22621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa8cdbf41164c03a3989b0c3304ea6a, State: Initialized, Role: FOLLOWER
I20260923 14:41:02.060731 22621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36323 } }
I20260923 14:41:02.060866 22621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:02.060930 22621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:02.061046 22621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:02.062139 22621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36323 } }
I20260923 14:41:02.062465 22621 leader_election.cc:302] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fa8cdbf41164c03a3989b0c3304ea6a; no voters:
I20260923 14:41:02.062783 22621 leader_election.cc:288] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:02.062971 22626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:02.063249 22626 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [term 1 LEADER]: Becoming Leader. State: Replica: 8fa8cdbf41164c03a3989b0c3304ea6a, State: Running, Role: LEADER
I20260923 14:41:02.063522 22626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36323 } }
I20260923 14:41:02.064066 22621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:02.065160 22628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fa8cdbf41164c03a3989b0c3304ea6a. Latest consensus state: current_term: 1 leader_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36323 } } }
I20260923 14:41:02.065272 22628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.065636 22635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:02.065913 22627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa8cdbf41164c03a3989b0c3304ea6a" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36323 } } }
I20260923 14:41:02.066046 22627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.069005 22635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:02.074473 22635 catalog_manager.cc:1347] Generated new cluster ID: 69b579e2652c4820a2ee6ca7dfb6f63f
I20260923 14:41:02.074555 22635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:02.095062 22635 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:02.096259 22635 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:02.104786 22635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fa8cdbf41164c03a3989b0c3304ea6a: Generated new TSK 0
I20260923 14:41:02.105605 22635 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 14:41:02.143021 22651 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260923 14:41:02.143157 22651 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 14:41:02.143783 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.126978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.17.4.190:36323)
0923 14:41:02.127134 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.127139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.127453 (+ 314us) server_negotiation.cc:407] Connection header received
0923 14:41:02.127742 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.127746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.127874 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.128003 (+ 129us) server_negotiation.cc:226] Negotiated authn=JWT
0923 14:41:02.128340 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.128884 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.129799 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.130028 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.130132 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.130491 (+ 359us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 14:41:02.143302 (+ 12811us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38335/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 14:41:02.143609 (+ 307us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38335/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":59}
W20260923 14:41:02.143862 22624 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38335/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260923 14:41:02.144882 22650 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:02.126909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36323 (local address 127.0.0.1:42384)
0923 14:41:02.127357 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:02.127373 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:02.127514 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:02.128022 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:02.128025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:02.128033 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0923 14:41:02.128179 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:02.128185 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.129038 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.129041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:02.129670 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:02.129677 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.130151 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.130155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:02.130254 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.130298 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 14:41:02.143524 (+ 13226us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38335/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 14:41:02.143748 (+ 224us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.4.190:36323: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38335/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":114,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.4.190:36323: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38335/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260923 14:41:02.145835 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22554
2026-09-23T14:41:02Z chronyd exiting
I20260923 14:41:02.183147 17426 test_util.cc:175] -----------------------------------------------
I20260923 14:41:02.183262 17426 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790174436877568-17426-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (315 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260923 14:41:02.184404 17426 mini_oidc.cc:152] Starting JWKS server
I20260923 14:41:02.185314 17426 webserver.cc:460] Webserver started at https://127.0.0.1:38727/ using document root <none> and password file <none>
I20260923 14:41:02.185446 17426 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 14:41:02.185719 17426 webserver.cc:460] Webserver started at http://127.0.0.1:35585/ using document root <none> and password file <none>
2026-09-23T14:41:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:02Z Disabled control of system clock
I20260923 14:41:02.194574 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35691
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:43869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:35691
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38727/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/testchainca.cert with env {}
W20260923 14:41:02.305369 22657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:02.305645 22657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:02.305686 22657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:02.309746 22657 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:02.309808 22657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:02.309824 22657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:02.309841 22657 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:02.309857 22657 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 14:41:02.309873 22657 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 14:41:02.309887 22657 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38727/jwks.json
I20260923 14:41:02.315316 22657 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:35691
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38727/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:02.316381 22657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:02.317349 22657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:02.326010 22662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:02.326009 22663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:02.326009 22665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:02.326131 22657 server_base.cc:1034] running on GCE node
I20260923 14:41:02.326869 22657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:02.328019 22657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:02.329213 22657 hybrid_clock.cc:648] HybridClock initialized: now 1790174462329179 us; error 45 us; skew 500 ppm
I20260923 14:41:02.331216 22657 webserver.cc:460] Webserver started at http://127.17.4.190:39793/ using document root <none> and password file <none>
I20260923 14:41:02.331871 22657 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:02.331964 22657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:02.332202 22657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:02.334344 22657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "54b676f9c9374ddf83a75d6f425577d4"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "2c0bdfad288624713351bf20d9311499"
server_key_iv: "8ff799ed123c10e229f5838beddae093"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.334976 22657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "54b676f9c9374ddf83a75d6f425577d4"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "2c0bdfad288624713351bf20d9311499"
server_key_iv: "8ff799ed123c10e229f5838beddae093"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.339030 22657 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 14:41:02.341881 22671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:02.343226 22657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:41:02.343415 22657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "54b676f9c9374ddf83a75d6f425577d4"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "2c0bdfad288624713351bf20d9311499"
server_key_iv: "8ff799ed123c10e229f5838beddae093"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.343559 22657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:02.358489 22657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:02.359200 22657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:02.359401 22657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:02.366338 22657 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:35691
I20260923 14:41:02.366349 22723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:35691 every 8 connection(s)
I20260923 14:41:02.367262 22657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:02.370371 22724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:02.370572 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22657
I20260923 14:41:02.370699 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:02.370998 17426 external_mini_cluster.cc:1428] Setting key 0621f58702ac0e5b197b950af31b3eb3
I20260923 14:41:02.377279 22724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4: Bootstrap starting.
I20260923 14:41:02.379738 22724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:02.380244 22727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.372217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41298 (local address 127.17.4.190:35691)
0923 14:41:02.372795 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.372810 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.372844 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:41:02.373767 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.373785 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.374171 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.374501 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:02.374914 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.375942 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.376867 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.377336 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.377499 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.378431 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:02.378436 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:02.378447 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:02.378832 (+ 385us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:02.378903 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:02.378934 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:02.379009 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:02.379169 (+ 160us) server_negotiation.cc:299] Negotiation successful
0923 14:41:02.379451 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":106,"threads_started":1}
I20260923 14:41:02.380544 22724 log.cc:824] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:02.382550 22724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4: No bootstrap required, opened a new log
I20260923 14:41:02.382952 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:41:02.386332 22724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b676f9c9374ddf83a75d6f425577d4" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35691 } }
I20260923 14:41:02.386567 22724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:02.386653 22724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b676f9c9374ddf83a75d6f425577d4, State: Initialized, Role: FOLLOWER
I20260923 14:41:02.387110 22724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b676f9c9374ddf83a75d6f425577d4" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35691 } }
I20260923 14:41:02.387259 22724 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:02.387351 22724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:02.387449 22724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:02.388391 22724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b676f9c9374ddf83a75d6f425577d4" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35691 } }
I20260923 14:41:02.388717 22724 leader_election.cc:302] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54b676f9c9374ddf83a75d6f425577d4; no voters:
I20260923 14:41:02.389024 22724 leader_election.cc:288] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:02.389132 22729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:02.389402 22729 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [term 1 LEADER]: Becoming Leader. State: Replica: 54b676f9c9374ddf83a75d6f425577d4, State: Running, Role: LEADER
I20260923 14:41:02.389683 22729 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b676f9c9374ddf83a75d6f425577d4" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35691 } }
I20260923 14:41:02.390219 22724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:02.391351 22731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54b676f9c9374ddf83a75d6f425577d4. Latest consensus state: current_term: 1 leader_uuid: "54b676f9c9374ddf83a75d6f425577d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b676f9c9374ddf83a75d6f425577d4" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35691 } } }
I20260923 14:41:02.391486 22731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.391804 22730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54b676f9c9374ddf83a75d6f425577d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b676f9c9374ddf83a75d6f425577d4" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35691 } } }
I20260923 14:41:02.391897 22730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.392040 22738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:02.395023 22738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:02.400302 22738 catalog_manager.cc:1347] Generated new cluster ID: 4333ffbc5bda495187d528da1df53c15
I20260923 14:41:02.400377 22738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:02.426256 22738 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:02.427129 22738 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:02.432058 22738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54b676f9c9374ddf83a75d6f425577d4: Generated new TSK 0
I20260923 14:41:02.432719 22738 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 14:41:02.456194 22754 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260923 14:41:02.456279 22754 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 14:41:02.456876 22727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.441180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41302 (local address 127.17.4.190:35691)
0923 14:41:02.441320 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.441328 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.441482 (+ 154us) server_negotiation.cc:407] Connection header received
0923 14:41:02.441650 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.441652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.441711 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.441799 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0923 14:41:02.442081 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.442590 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.443859 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.444068 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.444140 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.444475 (+ 335us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 14:41:02.456556 (+ 12081us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38727/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 14:41:02.456769 (+ 213us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41302: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38727/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":57}
W20260923 14:41:02.456959 22727 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41302: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38727/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260923 14:41:02.457120 22753 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:02.441085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35691 (local address 127.0.0.1:41302)
0923 14:41:02.441389 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:02.441405 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:02.441527 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:02.441836 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:02.441839 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:02.441848 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0923 14:41:02.441963 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:02.441969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.442707 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.442711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:02.443714 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:02.443725 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.444183 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.444187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:02.444282 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.444310 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 14:41:02.456746 (+ 12436us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38727/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 14:41:02.456929 (+ 183us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.4.190:35691: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38727/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":121,"threads_started":1}
I20260923 14:41:02.458026 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22657
2026-09-23T14:41:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (311 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260923 14:41:02.496381 17426 mini_oidc.cc:152] Starting JWKS server
I20260923 14:41:02.497308 17426 webserver.cc:460] Webserver started at https://127.0.0.1:43567/ using document root <none> and password file <none>
I20260923 14:41:02.497438 17426 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 14:41:02.497742 17426 webserver.cc:460] Webserver started at http://127.0.0.1:39565/ using document root <none> and password file <none>
2026-09-23T14:41:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:02Z Disabled control of system clock
I20260923 14:41:02.506927 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34937
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:36369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:34937
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43567/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 14:41:02.617828 22760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:02.618094 22760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:02.618132 22760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:02.622129 22760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:02.622186 22760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:02.622201 22760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:02.622218 22760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:02.622233 22760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 14:41:02.622248 22760 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 14:41:02.622262 22760 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43567/jwks.json
I20260923 14:41:02.626791 22760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:34937
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43567/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:02.627852 22760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:02.629341 22760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:02.637686 22760 server_base.cc:1034] running on GCE node
W20260923 14:41:02.637640 22765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:02.637715 22768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:02.637640 22766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:02.638417 22760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:02.639570 22760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:02.640758 22760 hybrid_clock.cc:648] HybridClock initialized: now 1790174462640748 us; error 64 us; skew 500 ppm
I20260923 14:41:02.642625 22760 webserver.cc:460] Webserver started at http://127.17.4.190:44657/ using document root <none> and password file <none>
I20260923 14:41:02.643217 22760 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:02.643306 22760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:02.643535 22760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:02.645622 22760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "15806b29dd8b3c959c1766b17bf03196"
server_key_iv: "75de2c24d83bee6c0ced5c03b6bc0bd4"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.646188 22760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "15806b29dd8b3c959c1766b17bf03196"
server_key_iv: "75de2c24d83bee6c0ced5c03b6bc0bd4"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.649859 22760 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:41:02.652364 22774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:02.653617 22760 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:02.653766 22760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "15806b29dd8b3c959c1766b17bf03196"
server_key_iv: "75de2c24d83bee6c0ced5c03b6bc0bd4"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.653889 22760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:02.666456 22760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:02.667114 22760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:02.667302 22760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:02.674399 22760 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:34937
I20260923 14:41:02.674420 22826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:34937 every 8 connection(s)
I20260923 14:41:02.675334 22760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:02.678236 22827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:02.682721 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22760
I20260923 14:41:02.682869 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:02.683142 17426 external_mini_cluster.cc:1428] Setting key 3faa4103f7a116bfb63d4c9b51da1bbc
I20260923 14:41:02.683962 22827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5: Bootstrap starting.
I20260923 14:41:02.686594 22827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:02.687461 22827 log.cc:824] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:02.689489 22827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5: No bootstrap required, opened a new log
I20260923 14:41:02.693739 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.684567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54156 (local address 127.17.4.190:34937)
0923 14:41:02.685269 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.685288 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.685331 (+ 43us) server_negotiation.cc:407] Connection header received
0923 14:41:02.686174 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.686197 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.686739 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.687112 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:02.687577 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.688949 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.689838 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.690513 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.690690 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.691466 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:02.691472 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:02.691489 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:02.692058 (+ 569us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:02.692129 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:02.692156 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:02.692254 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:02.692408 (+ 154us) server_negotiation.cc:299] Negotiation successful
0923 14:41:02.692699 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":104,"threads_started":1}
I20260923 14:41:02.693996 22827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34937 } }
I20260923 14:41:02.694231 22827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:02.694315 22827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab40e34d1b24b3d8bdda5d6d1dca4d5, State: Initialized, Role: FOLLOWER
I20260923 14:41:02.694752 22827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34937 } }
I20260923 14:41:02.694919 22827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:02.694983 22827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:02.695082 22827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:02.696197 22827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34937 } }
I20260923 14:41:02.696560 22827 leader_election.cc:302] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ab40e34d1b24b3d8bdda5d6d1dca4d5; no voters:
I20260923 14:41:02.696797 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:41:02.696910 22827 leader_election.cc:288] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:02.696974 22832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:02.697175 22832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [term 1 LEADER]: Becoming Leader. State: Replica: 4ab40e34d1b24b3d8bdda5d6d1dca4d5, State: Running, Role: LEADER
I20260923 14:41:02.697455 22832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34937 } }
I20260923 14:41:02.698220 22827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:02.698702 22834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34937 } } }
I20260923 14:41:02.698829 22834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.699201 22833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ab40e34d1b24b3d8bdda5d6d1dca4d5. Latest consensus state: current_term: 1 leader_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab40e34d1b24b3d8bdda5d6d1dca4d5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34937 } } }
I20260923 14:41:02.699318 22833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.700552 22837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:02.703074 22837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:02.708489 22837 catalog_manager.cc:1347] Generated new cluster ID: fed86dfa9bdf4921a70ad580dfd913da
I20260923 14:41:02.708562 22837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:02.714082 22837 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:02.714927 22837 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:02.718246 22837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ab40e34d1b24b3d8bdda5d6d1dca4d5: Generated new TSK 0
I20260923 14:41:02.718979 22837 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:41:02.730607 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.725795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54172 (local address 127.17.4.190:34937)
0923 14:41:02.725912 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.725917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.726100 (+ 183us) server_negotiation.cc:407] Connection header received
0923 14:41:02.726301 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.726304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.726348 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.726457 (+ 109us) server_negotiation.cc:226] Negotiated authn=JWT
0923 14:41:02.726710 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.727226 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.728207 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.728425 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.728536 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.728837 (+ 301us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 14:41:02.730258 (+ 1421us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43567/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 14:41:02.730475 (+ 217us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54172: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43567/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":40}
W20260923 14:41:02.730664 22830 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54172: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43567/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260923 14:41:02.732623 22856 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:02.725709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34937 (local address 127.0.0.1:54172)
0923 14:41:02.726006 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:02.726025 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:02.726150 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:02.726461 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:02.726464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:02.726472 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0923 14:41:02.726591 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:02.726603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.727360 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.727364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:02.728070 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:02.728079 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.728544 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.728548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:02.728648 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.728669 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 14:41:02.730421 (+ 1752us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43567/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 14:41:02.732456 (+ 2035us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.4.190:34937: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43567/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":1850,"thread_start_us":98,"threads_started":1}
I20260923 14:41:02.733300 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22760
E20260923 14:41:02.741916 22857 webserver.cc:533] Webserver: sslize failed:
E20260923 14:41:02.742007 22857 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-23T14:41:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (276 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-23T14:41:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:02Z Disabled control of system clock
I20260923 14:41:02.780654 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46285
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:34637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46285
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/testchainca.cert with env {}
W20260923 14:41:02.882815 22861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:02.883201 22861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:02.883275 22861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:02.887445 22861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:02.887535 22861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:02.887564 22861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:02.887606 22861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:02.887641 22861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 14:41:02.887676 22861 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 14:41:02.887710 22861 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260923 14:41:02.892970 22861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:02.893982 22861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:02.894953 22861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:02.903275 22867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:02.903309 22869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:02.903359 22861 server_base.cc:1034] running on GCE node
W20260923 14:41:02.903330 22866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:02.904032 22861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:02.904996 22861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:02.906144 22861 hybrid_clock.cc:648] HybridClock initialized: now 1790174462906119 us; error 39 us; skew 500 ppm
I20260923 14:41:02.911131 22861 webserver.cc:460] Webserver started at http://127.17.4.190:39007/ using document root <none> and password file <none>
I20260923 14:41:02.911687 22861 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:02.911747 22861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:02.912009 22861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:02.913925 22861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "bb58522d9a04464fbe17683995857bdb"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "21568630c49c09bb757ab5f518764e76"
server_key_iv: "c3825c67f3267bcb5cc472ba358ac30e"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.914467 22861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "bb58522d9a04464fbe17683995857bdb"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "21568630c49c09bb757ab5f518764e76"
server_key_iv: "c3825c67f3267bcb5cc472ba358ac30e"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.917876 22861 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 14:41:02.920133 22875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:02.921253 22861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:02.921382 22861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "bb58522d9a04464fbe17683995857bdb"
format_stamp: "Formatted at 2026-09-23 14:41:02 on dist-test-slave-54kg"
server_key: "21568630c49c09bb757ab5f518764e76"
server_key_iv: "c3825c67f3267bcb5cc472ba358ac30e"
server_key_version: "encryptionkey@0"
I20260923 14:41:02.921505 22861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:02.955422 22861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:02.956163 22861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:02.956359 22861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:02.963248 22861 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:46285
I20260923 14:41:02.963270 22927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:46285 every 8 connection(s)
I20260923 14:41:02.964206 22861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:02.965780 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22861
I20260923 14:41:02.965903 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:02.966215 17426 external_mini_cluster.cc:1428] Setting key 0b7cac1aeeb623915f509fdf325c645c
I20260923 14:41:02.967511 22928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:02.973285 22928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb: Bootstrap starting.
I20260923 14:41:02.975257 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:02.967577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49596 (local address 127.17.4.190:46285)
0923 14:41:02.968245 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:02.968260 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:02.968294 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:41:02.968923 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:02.968938 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:02.969327 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:02.969654 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:02.970074 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.971016 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.971993 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:02.972487 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:02.972663 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:02.973625 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:02.973629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:02.973641 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:02.974018 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:02.974070 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:02.974089 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:02.974214 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:02.974329 (+ 115us) server_negotiation.cc:299] Negotiation successful
0923 14:41:02.974573 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":183,"threads_started":1}
I20260923 14:41:02.975642 22928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:02.976502 22928 log.cc:824] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:02.978192 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:41:02.978758 22928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb: No bootstrap required, opened a new log
I20260923 14:41:02.982254 22928 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb58522d9a04464fbe17683995857bdb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46285 } }
I20260923 14:41:02.982520 22928 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:02.982584 22928 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb58522d9a04464fbe17683995857bdb, State: Initialized, Role: FOLLOWER
I20260923 14:41:02.983042 22928 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb58522d9a04464fbe17683995857bdb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46285 } }
I20260923 14:41:02.983163 22928 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:02.983269 22928 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:02.983381 22928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:02.984364 22928 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb58522d9a04464fbe17683995857bdb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46285 } }
I20260923 14:41:02.984700 22928 leader_election.cc:302] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb58522d9a04464fbe17683995857bdb; no voters:
I20260923 14:41:02.984993 22928 leader_election.cc:288] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:02.985113 22933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:02.985334 22933 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [term 1 LEADER]: Becoming Leader. State: Replica: bb58522d9a04464fbe17683995857bdb, State: Running, Role: LEADER
I20260923 14:41:02.985651 22933 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb58522d9a04464fbe17683995857bdb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46285 } }
I20260923 14:41:02.986250 22928 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:02.987257 22934 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb58522d9a04464fbe17683995857bdb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb58522d9a04464fbe17683995857bdb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46285 } } }
I20260923 14:41:02.987411 22934 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.987679 22935 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb58522d9a04464fbe17683995857bdb. Latest consensus state: current_term: 1 leader_uuid: "bb58522d9a04464fbe17683995857bdb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb58522d9a04464fbe17683995857bdb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46285 } } }
I20260923 14:41:02.987797 22935 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:02.987911 22942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:02.990752 22942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:02.996088 22942 catalog_manager.cc:1347] Generated new cluster ID: f71056f13b364fa39ad227399f0a1aa0
I20260923 14:41:02.996162 22942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:03.008740 22942 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:03.009995 22942 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:03.022500 22942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb58522d9a04464fbe17683995857bdb: Generated new TSK 0
I20260923 14:41:03.023306 22942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:41:03.098021 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:03.042001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49604 (local address 127.17.4.190:46285)
0923 14:41:03.042157 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:03.042163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:03.042339 (+ 176us) server_negotiation.cc:407] Connection header received
0923 14:41:03.042502 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:03.042504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:03.042549 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:03.042639 (+ 90us) server_negotiation.cc:226] Negotiated authn=JWT
0923 14:41:03.042913 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:03.043422 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:03.044680 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:03.044885 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:03.044959 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:03.045301 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 14:41:03.097629 (+ 52328us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 14:41:03.097900 (+ 271us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49604: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":65}
W20260923 14:41:03.098115 22931 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49604: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260923 14:41:03.098333 22957 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:03.041928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46285 (local address 127.0.0.1:49604)
0923 14:41:03.042244 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:03.042259 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:03.042375 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:03.042665 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:03.042668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:03.042677 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0923 14:41:03.042809 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:03.042816 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:03.043529 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:03.043534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:03.044566 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:03.044577 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:03.045003 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:03.045014 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:03.045104 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:03.045133 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 14:41:03.097889 (+ 52756us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 14:41:03.098135 (+ 246us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.4.190:46285: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":125,"threads_started":1}
I20260923 14:41:03.098951 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22861
2026-09-23T14:41:03Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (345 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (119 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (119 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:03 dist-test-slave-54kg krb5kdc[22969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:03 dist-test-slave-54kg krb5kdc[22969](info): set up 2 sockets
Sep 23 14:41:03 dist-test-slave-54kg krb5kdc[22969](info): commencing operation
krb5kdc: starting...
W20260923 14:41:04.361334 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.003s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:04 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:41:04.482805 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36839
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:35129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:36839
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:04.592208 22982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:04.592530 22982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:04.592635 22982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:04.596719 22982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:04.596805 22982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:04.596843 22982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:04.596900 22982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:04.596937 22982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:04.602394 22982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:36839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:04.603485 22982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:04.604580 22982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:04.612927 22990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:04.612936 22988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:04.612936 22987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:04.613080 22982 server_base.cc:1034] running on GCE node
I20260923 14:41:04.613746 22982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:04.614792 22982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:04.615969 22982 hybrid_clock.cc:648] HybridClock initialized: now 1790174464615952 us; error 31 us; skew 500 ppm
Sep 23 14:41:04 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:04.618685 22982 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:41:04.619464 22982 webserver.cc:460] Webserver started at http://127.17.4.190:39699/ using document root <none> and password file <none>
I20260923 14:41:04.620036 22982 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:04.620096 22982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:04.620265 22982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:04.622198 22982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "a3c76c866ad8400392438cca4f2a200d"
format_stamp: "Formatted at 2026-09-23 14:41:04 on dist-test-slave-54kg"
server_key: "98f69d952d3447ccef2991236daed74e"
server_key_iv: "23517b8c25ae2104af8f63b4e3153f9f"
server_key_version: "encryptionkey@0"
I20260923 14:41:04.622706 22982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "a3c76c866ad8400392438cca4f2a200d"
format_stamp: "Formatted at 2026-09-23 14:41:04 on dist-test-slave-54kg"
server_key: "98f69d952d3447ccef2991236daed74e"
server_key_iv: "23517b8c25ae2104af8f63b4e3153f9f"
server_key_version: "encryptionkey@0"
I20260923 14:41:04.626194 22982 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:41:04.628465 22997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:04.629637 22982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:04.629732 22982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "a3c76c866ad8400392438cca4f2a200d"
format_stamp: "Formatted at 2026-09-23 14:41:04 on dist-test-slave-54kg"
server_key: "98f69d952d3447ccef2991236daed74e"
server_key_iv: "23517b8c25ae2104af8f63b4e3153f9f"
server_key_version: "encryptionkey@0"
I20260923 14:41:04.629812 22982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:04.647004 22982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:04.650290 22982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:04.650449 22982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:04.657258 22982 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:36839
I20260923 14:41:04.657334 23049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:36839 every 8 connection(s)
I20260923 14:41:04.658252 22982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:04.658502 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 22982
I20260923 14:41:04.658634 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:04.658989 17426 external_mini_cluster.cc:1428] Setting key b2dcb7bf071e6de6c503bb094784fd64
I20260923 14:41:04.661684 23050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:04.667095 23050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d: Bootstrap starting.
Sep 23 14:41:04 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:04.669337 23050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:04.670042 23050 log.cc:824] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:04.672041 23050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d: No bootstrap required, opened a new log
I20260923 14:41:04.672821 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:04.660491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43534 (local address 127.17.4.190:36839)
0923 14:41:04.660947 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:04.660962 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:04.660998 (+ 36us) server_negotiation.cc:407] Connection header received
0923 14:41:04.661632 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:04.661658 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:04.662041 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:04.662386 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:04.663179 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:04.664236 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:04.665067 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:04.665531 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:04.665708 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:04.668215 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:04.668220 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:04.668233 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:04.668259 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:04.670011 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:04.670472 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:04.670477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:04.670481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:04.670586 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:04.670873 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:04.670877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:04.670879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:04.671264 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:04.671460 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:04.671782 (+ 322us) server_negotiation.cc:299] Negotiation successful
0923 14:41:04.672067 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":147,"threads_started":1}
I20260923 14:41:04.675694 23050 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c76c866ad8400392438cca4f2a200d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36839 } }
I20260923 14:41:04.676002 23050 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:04.676091 23050 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3c76c866ad8400392438cca4f2a200d, State: Initialized, Role: FOLLOWER
I20260923 14:41:04.676563 23050 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c76c866ad8400392438cca4f2a200d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36839 } }
I20260923 14:41:04.676713 23050 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:04.676781 23050 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:04.676878 23050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:04.677842 23050 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c76c866ad8400392438cca4f2a200d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36839 } }
I20260923 14:41:04.678203 23050 leader_election.cc:302] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3c76c866ad8400392438cca4f2a200d; no voters:
I20260923 14:41:04.678551 23050 leader_election.cc:288] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:04.678640 23055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:04.678920 23055 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [term 1 LEADER]: Becoming Leader. State: Replica: a3c76c866ad8400392438cca4f2a200d, State: Running, Role: LEADER
I20260923 14:41:04.679231 23055 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c76c866ad8400392438cca4f2a200d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36839 } }
I20260923 14:41:04.679910 23050 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:04.681030 23057 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3c76c866ad8400392438cca4f2a200d. Latest consensus state: current_term: 1 leader_uuid: "a3c76c866ad8400392438cca4f2a200d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c76c866ad8400392438cca4f2a200d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36839 } } }
I20260923 14:41:04.681183 23057 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:04.681025 23056 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3c76c866ad8400392438cca4f2a200d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3c76c866ad8400392438cca4f2a200d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36839 } } }
I20260923 14:41:04.681468 23056 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:04.681567 23064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:04.684569 23064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:04.690874 23064 catalog_manager.cc:1347] Generated new cluster ID: 01b4b2f5743347c2820ef002c57247bc
I20260923 14:41:04.690954 23064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:04.701674 23064 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:04.702934 23064 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:04.713882 23064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3c76c866ad8400392438cca4f2a200d: Generated new TSK 0
I20260923 14:41:04.714766 23064 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:41:04.742971 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36839
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:35129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:04.852586 23076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:04.852860 23076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:04.852929 23076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:04.856992 23076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:04.857070 23076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:04.857159 23076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:04.862548 23076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:04.863683 23076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:04.864737 23076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:04.874006 23084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:04.874006 23081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:04.874007 23082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:04.874048 23076 server_base.cc:1034] running on GCE node
I20260923 14:41:04.874615 23076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:04.875206 23076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:04.876379 23076 hybrid_clock.cc:648] HybridClock initialized: now 1790174464876365 us; error 27 us; skew 500 ppm
Sep 23 14:41:04 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:04.879081 23076 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:41:04.879977 23076 webserver.cc:460] Webserver started at http://127.17.4.129:36283/ using document root <none> and password file <none>
I20260923 14:41:04.880474 23076 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:04.880528 23076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:04.880724 23076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:04.882702 23076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "393c082ad8a24792b21fc6376e971d91"
format_stamp: "Formatted at 2026-09-23 14:41:04 on dist-test-slave-54kg"
server_key: "cbfa091f9fad65ca77638337fa8194e9"
server_key_iv: "0ac749f1c059117f7bd6e5fd026faf25"
server_key_version: "encryptionkey@0"
I20260923 14:41:04.883185 23076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "393c082ad8a24792b21fc6376e971d91"
format_stamp: "Formatted at 2026-09-23 14:41:04 on dist-test-slave-54kg"
server_key: "cbfa091f9fad65ca77638337fa8194e9"
server_key_iv: "0ac749f1c059117f7bd6e5fd026faf25"
server_key_version: "encryptionkey@0"
I20260923 14:41:04.886646 23076 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:41:04.888991 23091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:04.890152 23076 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:04.890262 23076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "393c082ad8a24792b21fc6376e971d91"
format_stamp: "Formatted at 2026-09-23 14:41:04 on dist-test-slave-54kg"
server_key: "cbfa091f9fad65ca77638337fa8194e9"
server_key_iv: "0ac749f1c059117f7bd6e5fd026faf25"
server_key_version: "encryptionkey@0"
I20260923 14:41:04.890358 23076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:04.913856 23076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:04.917178 23076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:04.917376 23076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:04.917985 23076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:04.918785 23076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:04.918830 23076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:04.918902 23076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:04.918932 23076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:04.928253 23076 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:42537
I20260923 14:41:04.928295 23204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:42537 every 8 connection(s)
I20260923 14:41:04.929181 23076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:04.929565 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23076
I20260923 14:41:04.929709 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:04.930014 17426 external_mini_cluster.cc:1428] Setting key e1d02335b5874fe05d49a91dd0abbec3
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Sep 23 14:41:04 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:41:04.944736 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:04.930982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:46875 (local address 127.17.4.190:36839)
0923 14:41:04.931112 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:04.931116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:04.932177 (+ 1061us) server_negotiation.cc:407] Connection header received
0923 14:41:04.934017 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:04.934020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:04.934099 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:04.934238 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:04.935410 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:04.936061 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:04.937948 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:04.938186 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:04.938275 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:04.941058 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:04.941061 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:04.941063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:04.941086 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:04.942450 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:04.943017 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:04.943020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:04.943021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:04.943093 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:04.943433 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:04.943439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:04.943443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:04.943742 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:04.943880 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:04.944341 (+ 461us) server_negotiation.cc:299] Negotiation successful
0923 14:41:04.944495 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:41:04.945389 23207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:04.931476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36839 (local address 127.17.4.129:46875)
0923 14:41:04.931995 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:04.932071 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:04.933811 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:04.934442 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:04.934448 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:04.934796 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:04.935267 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:04.935280 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:04.936188 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:04.936191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:04.937811 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:04.937823 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:04.938352 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:04.938358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:04.938565 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:04.939206 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:04.939234 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:04.940899 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:04.942550 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:04.942555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:04.942568 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:04.942920 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:04.943203 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:04.943206 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:04.943207 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:04.943337 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:04.943877 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:04.943882 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:04.944104 (+ 222us) client_negotiation.cc:769] Sending connection context
0923 14:41:04.944263 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 14:41:04.944510 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":104,"threads_started":1}
I20260923 14:41:04.946646 23205 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36839
I20260923 14:41:04.946871 23205 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:04.947338 23205 heartbeater.cc:511] Master 127.17.4.190:36839 requested a full tablet report, sending...
I20260923 14:41:04.948901 23014 ts_manager.cc:194] Registered new tserver with Master: 393c082ad8a24792b21fc6376e971d91 (127.17.4.129:42537)
I20260923 14:41:04.949962 23014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:46875
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:41:04.958658 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36839
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:35129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:05.068177 23210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:05.068409 23210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:05.068449 23210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:05.072564 23210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:05.072618 23210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:05.072674 23210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:05.077685 23210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:05.078536 23210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:05.079424 23210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:05.088662 23216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:05.088680 23215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:05.088806 23210 server_base.cc:1034] running on GCE node
W20260923 14:41:05.088824 23218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:05.089334 23210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:05.089910 23210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:05.091086 23210 hybrid_clock.cc:648] HybridClock initialized: now 1790174465091049 us; error 48 us; skew 500 ppm
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.093631 23210 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:41:05.094547 23210 webserver.cc:460] Webserver started at http://127.17.4.130:37591/ using document root <none> and password file <none>
I20260923 14:41:05.095069 23210 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:05.095163 23210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:05.095378 23210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:05.097363 23210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "d1180f8442af4e24b1d01932a6de453b"
format_stamp: "Formatted at 2026-09-23 14:41:05 on dist-test-slave-54kg"
server_key: "99b743634db7a32b67b3673fe2a72cb7"
server_key_iv: "ccc20ee9480cbf7c6eb062682c5bdca0"
server_key_version: "encryptionkey@0"
I20260923 14:41:05.097899 23210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "d1180f8442af4e24b1d01932a6de453b"
format_stamp: "Formatted at 2026-09-23 14:41:05 on dist-test-slave-54kg"
server_key: "99b743634db7a32b67b3673fe2a72cb7"
server_key_iv: "ccc20ee9480cbf7c6eb062682c5bdca0"
server_key_version: "encryptionkey@0"
I20260923 14:41:05.101383 23210 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 14:41:05.103649 23225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:05.104864 23210 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:41:05.104995 23210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "d1180f8442af4e24b1d01932a6de453b"
format_stamp: "Formatted at 2026-09-23 14:41:05 on dist-test-slave-54kg"
server_key: "99b743634db7a32b67b3673fe2a72cb7"
server_key_iv: "ccc20ee9480cbf7c6eb062682c5bdca0"
server_key_version: "encryptionkey@0"
I20260923 14:41:05.105111 23210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:05.133157 23210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:05.136260 23210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:05.136463 23210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:05.137050 23210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:05.137873 23210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:05.137943 23210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:05.138015 23210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:05.138065 23210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:05.146692 23210 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:34077
I20260923 14:41:05.146718 23338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:34077 every 8 connection(s)
I20260923 14:41:05.147549 23210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:05.155005 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23210
I20260923 14:41:05.155170 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:05.155454 17426 external_mini_cluster.cc:1428] Setting key b39d6949679d89014d994d15c88d069d
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:05.161878 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.149294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41427 (local address 127.17.4.190:36839)
0923 14:41:05.149436 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.149441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.150289 (+ 848us) server_negotiation.cc:407] Connection header received
0923 14:41:05.151564 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.151567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.151614 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.151696 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.152899 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.153446 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.154523 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.154791 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.154900 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.157576 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:05.157590 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:05.157597 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:05.157630 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:05.159653 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.160198 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.160204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.160209 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.160298 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.160624 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.160629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.160634 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.160895 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:05.160996 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:05.161500 (+ 504us) server_negotiation.cc:299] Negotiation successful
0923 14:41:05.161655 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:41:05.162606 23341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.149718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36839 (local address 127.17.4.130:41427)
0923 14:41:05.150144 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:05.150185 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:05.151348 (+ 1163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:05.151917 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:05.151924 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:05.152266 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:05.152766 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:05.152780 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.153555 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.153558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:05.154422 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:05.154430 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.154931 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.154933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:05.155065 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.155731 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:05.155747 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:05.157374 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:05.159816 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:05.159821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:05.159834 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:05.160095 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:05.160392 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:05.160394 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:05.160396 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:05.160521 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:05.160994 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:05.160999 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:05.161236 (+ 237us) client_negotiation.cc:769] Sending connection context
0923 14:41:05.161387 (+ 151us) client_negotiation.cc:240] Negotiation successful
0923 14:41:05.161712 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":99,"threads_started":1}
I20260923 14:41:05.163857 23339 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36839
I20260923 14:41:05.164093 23339 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:05.164574 23339 heartbeater.cc:511] Master 127.17.4.190:36839 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:41:05.165671 23014 ts_manager.cc:194] Registered new tserver with Master: d1180f8442af4e24b1d01932a6de453b (127.17.4.130:34077)
I20260923 14:41:05.166286 23014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:41427
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:41:05.182512 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36839
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:35129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:05.289736 23344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:05.289968 23344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:05.290009 23344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:05.293965 23344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:05.294018 23344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:05.294070 23344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:05.299259 23344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:05.300216 23344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:05.301087 23344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:05.310544 23352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:05.310586 23344 server_base.cc:1034] running on GCE node
W20260923 14:41:05.310611 23350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:05.310575 23349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:05.311146 23344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:05.311710 23344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:05.312928 23344 hybrid_clock.cc:648] HybridClock initialized: now 1790174465312913 us; error 26 us; skew 500 ppm
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.315624 23344 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:41:05.316553 23344 webserver.cc:460] Webserver started at http://127.17.4.131:34799/ using document root <none> and password file <none>
I20260923 14:41:05.317116 23344 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:05.317205 23344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:05.317414 23344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:05.319415 23344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "7f4bc982072246cf9239a1aa46644bd8"
format_stamp: "Formatted at 2026-09-23 14:41:05 on dist-test-slave-54kg"
server_key: "2f5725cf97a7d3462b1452c276dc714a"
server_key_iv: "e6a75b72aee6719fac9cdee7244882d9"
server_key_version: "encryptionkey@0"
I20260923 14:41:05.320011 23344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "7f4bc982072246cf9239a1aa46644bd8"
format_stamp: "Formatted at 2026-09-23 14:41:05 on dist-test-slave-54kg"
server_key: "2f5725cf97a7d3462b1452c276dc714a"
server_key_iv: "e6a75b72aee6719fac9cdee7244882d9"
server_key_version: "encryptionkey@0"
I20260923 14:41:05.323599 23344 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260923 14:41:05.325996 23359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:05.327229 23344 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260923 14:41:05.327366 23344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "7f4bc982072246cf9239a1aa46644bd8"
format_stamp: "Formatted at 2026-09-23 14:41:05 on dist-test-slave-54kg"
server_key: "2f5725cf97a7d3462b1452c276dc714a"
server_key_iv: "e6a75b72aee6719fac9cdee7244882d9"
server_key_version: "encryptionkey@0"
I20260923 14:41:05.327508 23344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:05.345371 23344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:05.348795 23344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:05.349007 23344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:05.349630 23344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:05.350466 23344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:05.350536 23344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:05.350607 23344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:05.350659 23344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:05.359714 23344 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:43761
I20260923 14:41:05.359738 23472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:43761 every 8 connection(s)
I20260923 14:41:05.360561 23344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:05.368458 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23344
I20260923 14:41:05.368602 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:05.368906 17426 external_mini_cluster.cc:1428] Setting key 057d0fe5bd8df96c013e78e85cf65b60
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:05.373656 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.362274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:59025 (local address 127.17.4.190:36839)
0923 14:41:05.362426 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.362431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.363265 (+ 834us) server_negotiation.cc:407] Connection header received
0923 14:41:05.364592 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.364595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.364641 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.364715 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.365803 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.366410 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.367490 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.367701 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.367836 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.370525 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:05.370529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:05.370531 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:05.370558 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:05.371978 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.372427 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.372430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.372431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.372502 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.372790 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.372792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.372793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.372955 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:05.373026 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:05.373452 (+ 426us) server_negotiation.cc:299] Negotiation successful
0923 14:41:05.373542 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:41:05.374454 23475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.362699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36839 (local address 127.17.4.131:59025)
0923 14:41:05.363115 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:05.363159 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:05.364402 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:05.364838 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:05.364843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:05.365168 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:05.365619 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:05.365630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.366537 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.366540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:05.367386 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:05.367393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.367837 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.367839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:05.367977 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.368586 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:05.368630 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:05.370367 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:05.372079 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:05.372084 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:05.372095 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:05.372341 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:05.372583 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:05.372585 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:05.372586 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:05.372714 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:05.373038 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:05.373042 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:05.373258 (+ 216us) client_negotiation.cc:769] Sending connection context
0923 14:41:05.373410 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 14:41:05.373662 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":102,"threads_started":1}
I20260923 14:41:05.375479 23473 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36839
I20260923 14:41:05.375730 23473 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:05.376237 23473 heartbeater.cc:511] Master 127.17.4.190:36839 requested a full tablet report, sending...
I20260923 14:41:05.377198 23014 ts_manager.cc:194] Registered new tserver with Master: 7f4bc982072246cf9239a1aa46644bd8 (127.17.4.131:43761)
I20260923 14:41:05.377729 23014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:59025
I20260923 14:41:05.382674 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/test-admin.keytab.
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.398229 17426 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260923 14:41:05.400965 23480 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:05.399582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.17.4.129:42537)
0923 14:41:05.399882 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.399896 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.399922 (+ 26us) server_negotiation.cc:407] Connection header received
0923 14:41:05.399973 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.399978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.400162 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.400277 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.400783 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52952: BlockingRecv error: recv got EOF from 127.0.0.1:52952 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":78,"threads_started":1}
W20260923 14:41:05.400992 17426 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc' of type FILE
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.401963 17426 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.402842 17426 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:41:05.412258 23480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.403666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.17.4.129:42537)
0923 14:41:05.403802 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.403808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.403896 (+ 88us) server_negotiation.cc:407] Connection header received
0923 14:41:05.403985 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.403987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.404022 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.404095 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.404568 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.405311 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.406081 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.406436 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.406513 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.408733 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:05.408741 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:05.408753 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:05.408775 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:05.410638 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.411004 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.411009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.411010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.411083 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.411294 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.411296 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.411297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.411503 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:05.411685 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:05.411969 (+ 284us) server_negotiation.cc:299] Negotiation successful
0923 14:41:05.412135 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260923 14:41:05.415951 23480 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:05.414876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52968 (local address 127.17.4.129:42537)
0923 14:41:05.414999 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.415003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.415123 (+ 120us) server_negotiation.cc:407] Connection header received
0923 14:41:05.415265 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.415268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.415305 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.415399 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.415857 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52968: BlockingRecv error: recv got EOF from 127.0.0.1:52968 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 14:41:05.416105 17426 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc' of type FILE
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.417065 17426 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.417920 17426 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:41:05.425993 23480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.418679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52976 (local address 127.17.4.129:42537)
0923 14:41:05.418798 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.418802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.418915 (+ 113us) server_negotiation.cc:407] Connection header received
0923 14:41:05.419068 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.419070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.419103 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.419167 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.419571 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.420174 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.420929 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.421140 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.421210 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.423212 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:05.423215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:05.423217 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:05.423236 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:05.424659 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.425010 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.425012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.425013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.425076 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.425296 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.425298 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.425300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.425436 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:05.425525 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:05.425713 (+ 188us) server_negotiation.cc:299] Negotiation successful
0923 14:41:05.425830 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260923 14:41:05.428591 23480 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:05.427619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52984 (local address 127.17.4.129:42537)
0923 14:41:05.427739 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.427743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.427848 (+ 105us) server_negotiation.cc:407] Connection header received
0923 14:41:05.427985 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.427988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.428026 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.428119 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.428490 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52984: BlockingRecv error: recv got EOF from 127.0.0.1:52984 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 14:41:05.428702 17426 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790174436877568-17426-0/krb5kdc/krb5cc' of type FILE
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.429651 17426 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:05.430459 17426 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[22969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:41:05.438522 23480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:05.431207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52988 (local address 127.17.4.129:42537)
0923 14:41:05.431382 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:05.431386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:05.431451 (+ 65us) server_negotiation.cc:407] Connection header received
0923 14:41:05.431590 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:05.431593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:05.431645 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:05.431727 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:05.432216 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.432809 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.433574 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:05.433791 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:05.433896 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:05.435996 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:05.435999 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:05.436001 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:05.436020 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:05.437162 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.437594 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.437596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.437597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.437663 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:05.437900 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:05.437903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:05.437904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:05.438042 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:05.438139 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:05.438332 (+ 193us) server_negotiation.cc:299] Negotiation successful
0923 14:41:05.438413 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260923 14:41:05.439586 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23076
I20260923 14:41:05.445116 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23210
I20260923 14:41:05.450361 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23344
I20260923 14:41:05.455411 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 22982
2026-09-23T14:41:05Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2118 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[23493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[23493](info): set up 2 sockets
Sep 23 14:41:05 dist-test-slave-54kg krb5kdc[23493](info): commencing operation
krb5kdc: starting...
W20260923 14:41:06.489156 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:06 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:06Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab.
Entry for principal oryx/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab.
I20260923 14:41:06.607213 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44463
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab
--principal=oryx/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:06.716063 23506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:06.716377 23506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:06.716447 23506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:06.720515 23506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:06.720606 23506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:06.720644 23506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:06.720707 23506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:06.720749 23506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:06.726022 23506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab
--principal=oryx/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:06.727142 23506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:06.728223 23506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:06.737360 23511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:06.737426 23506 server_base.cc:1034] running on GCE node
W20260923 14:41:06.737427 23514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:06.737352 23512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:06.738323 23506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:06.739461 23506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:06.740626 23506 hybrid_clock.cc:648] HybridClock initialized: now 1790174466740601 us; error 42 us; skew 500 ppm
Sep 23 14:41:06 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:06.743419 23506 init.cc:377] Logged in from keytab as oryx/127.17.4.190@KRBTEST.COM (short username oryx)
I20260923 14:41:06.744383 23506 webserver.cc:460] Webserver started at http://127.17.4.190:42233/ using document root <none> and password file <none>
I20260923 14:41:06.744948 23506 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:06.745008 23506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:06.745256 23506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:06.747305 23506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "108d5270212a410c9d51bfb74d86c98f"
format_stamp: "Formatted at 2026-09-23 14:41:06 on dist-test-slave-54kg"
server_key: "13878ccba876a81cf3fe7220a2666486"
server_key_iv: "f7889344af8d36763efeeea3d2f07b02"
server_key_version: "encryptionkey@0"
I20260923 14:41:06.747937 23506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "108d5270212a410c9d51bfb74d86c98f"
format_stamp: "Formatted at 2026-09-23 14:41:06 on dist-test-slave-54kg"
server_key: "13878ccba876a81cf3fe7220a2666486"
server_key_iv: "f7889344af8d36763efeeea3d2f07b02"
server_key_version: "encryptionkey@0"
I20260923 14:41:06.751730 23506 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 14:41:06.754225 23521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:06.755441 23506 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:06.755580 23506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "108d5270212a410c9d51bfb74d86c98f"
format_stamp: "Formatted at 2026-09-23 14:41:06 on dist-test-slave-54kg"
server_key: "13878ccba876a81cf3fe7220a2666486"
server_key_iv: "f7889344af8d36763efeeea3d2f07b02"
server_key_version: "encryptionkey@0"
I20260923 14:41:06.755699 23506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:06.771908 23506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:06.774920 23506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:06.775135 23506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:06.782364 23506 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44463
I20260923 14:41:06.782651 23573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44463 every 8 connection(s)
I20260923 14:41:06.783320 23506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:06.783516 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23506
I20260923 14:41:06.783656 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:06.784019 17426 external_mini_cluster.cc:1428] Setting key 39ada6e1825c8236d9d4580a884c4eac
I20260923 14:41:06.786644 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 14:41:06 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:06.793174 23574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Bootstrap starting.
I20260923 14:41:06.795856 23574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:06.796756 23574 log.cc:824] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:06.798735 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:06.785351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35558 (local address 127.17.4.190:44463)
0923 14:41:06.785753 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:06.785772 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:06.785811 (+ 39us) server_negotiation.cc:407] Connection header received
0923 14:41:06.786604 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:06.786625 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:06.787052 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:06.787401 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:06.788104 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:06.789591 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:06.790403 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:06.791042 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:06.791201 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:06.793778 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:06.793784 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:06.793799 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:06.793828 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:06.795685 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:06.796174 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:06.796179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:06.796185 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:06.796311 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:06.796576 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:06.796580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:06.796581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:06.797095 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:06.797267 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:06.797575 (+ 308us) server_negotiation.cc:299] Negotiation successful
0923 14:41:06.797857 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":118,"threads_started":1}
I20260923 14:41:06.798911 23574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: No bootstrap required, opened a new log
I20260923 14:41:06.802428 23574 raft_consensus.cc:348] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } }
I20260923 14:41:06.802623 23574 raft_consensus.cc:374] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:06.802665 23574 raft_consensus.cc:729] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 108d5270212a410c9d51bfb74d86c98f, State: Initialized, Role: FOLLOWER
I20260923 14:41:06.803045 23574 consensus_queue.cc:260] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } }
I20260923 14:41:06.803164 23574 raft_consensus.cc:388] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:06.803208 23574 raft_consensus.cc:482] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:06.803274 23574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:06.804117 23574 raft_consensus.cc:504] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } }
I20260923 14:41:06.804441 23574 leader_election.cc:302] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 108d5270212a410c9d51bfb74d86c98f; no voters:
I20260923 14:41:06.804744 23574 leader_election.cc:288] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:06.804816 23579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:06.805002 23579 raft_consensus.cc:686] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 LEADER]: Becoming Leader. State: Replica: 108d5270212a410c9d51bfb74d86c98f, State: Running, Role: LEADER
I20260923 14:41:06.805357 23579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } }
I20260923 14:41:06.805948 23574 sys_catalog.cc:564] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:06.807160 23580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } }
I20260923 14:41:06.807161 23581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 108d5270212a410c9d51bfb74d86c98f. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } }
I20260923 14:41:06.807304 23580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:06.807310 23581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:06.807677 23588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:06.810758 23588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:06.816485 23588 catalog_manager.cc:1347] Generated new cluster ID: 4f47fb55797546218928f2bd443ab036
I20260923 14:41:06.816556 23588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:06.844563 23588 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:06.845511 23588 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:06.849375 23588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Generated new TSK 0
I20260923 14:41:06.850025 23588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab.
Entry for principal oryx/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab.
I20260923 14:41:06.890918 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44463
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:07.000067 23600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:07.000344 23600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:07.000422 23600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:07.004339 23600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:07.004421 23600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:07.004509 23600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:07.009835 23600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:07.010913 23600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:07.011981 23600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:07.021170 23600 server_base.cc:1034] running on GCE node
W20260923 14:41:07.021202 23605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.021095 23608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.021090 23606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.021727 23600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:07.022338 23600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:07.023576 23600 hybrid_clock.cc:648] HybridClock initialized: now 1790174467023548 us; error 39 us; skew 500 ppm
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:07.026330 23600 init.cc:377] Logged in from keytab as oryx/127.17.4.129@KRBTEST.COM (short username oryx)
I20260923 14:41:07.027197 23600 webserver.cc:460] Webserver started at http://127.17.4.129:46795/ using document root <none> and password file <none>
I20260923 14:41:07.027829 23600 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:07.027899 23600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:07.028115 23600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:07.030125 23600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "d8d6c191d99f44bba8dadea90a9034a5"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "82991182269d757e74cd771bcd3578ef"
server_key_iv: "dc24641a6ac1750de366d13bace1252a"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.030699 23600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "d8d6c191d99f44bba8dadea90a9034a5"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "82991182269d757e74cd771bcd3578ef"
server_key_iv: "dc24641a6ac1750de366d13bace1252a"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.034512 23600 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 14:41:07.037070 23615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.038429 23600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:07.038565 23600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "d8d6c191d99f44bba8dadea90a9034a5"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "82991182269d757e74cd771bcd3578ef"
server_key_iv: "dc24641a6ac1750de366d13bace1252a"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.038708 23600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:07.071553 23600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:07.074347 23600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:07.074498 23600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:07.075038 23600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:07.075819 23600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:07.075872 23600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.075912 23600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:07.075935 23600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.084281 23600 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:32871
I20260923 14:41:07.084306 23728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:32871 every 8 connection(s)
I20260923 14:41:07.085148 23600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:07.087464 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23600
I20260923 14:41:07.087602 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:07.087945 17426 external_mini_cluster.cc:1428] Setting key a8b33ba80cb75f545ee75d31e71f52c5
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:41:07.099517 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.086944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:44695 (local address 127.17.4.190:44463)
0923 14:41:07.087084 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.087088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.088014 (+ 926us) server_negotiation.cc:407] Connection header received
0923 14:41:07.089747 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.089750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.089799 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.089883 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.091216 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.091737 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.092987 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.093230 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.093346 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.095754 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.095757 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.095800 (+ 43us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.095831 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.097332 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.097882 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.097885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.097886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.097958 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.098306 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.098311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.098312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.098491 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.098603 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.099157 (+ 554us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.099286 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.130@KRBTEST.COM" created.
I20260923 14:41:07.100376 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.087268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:44695)
0923 14:41:07.087864 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.087907 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.089532 (+ 1625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.090061 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.090068 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.090414 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.091055 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.091076 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.091890 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.091896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.092855 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.092864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.093381 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.093386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.093569 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.094183 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.094199 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.095585 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.097450 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.097455 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.097469 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.097743 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.098065 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.098068 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.098070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.098209 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.098599 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.098605 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.098844 (+ 239us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.099096 (+ 252us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.099415 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":144,"threads_started":1}
I20260923 14:41:07.101716 23729 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44463
I20260923 14:41:07.101949 23729 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:07.102427 23729 heartbeater.cc:511] Master 127.17.4.190:44463 requested a full tablet report, sending...
I20260923 14:41:07.103945 23538 ts_manager.cc:194] Registered new tserver with Master: d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871)
I20260923 14:41:07.105026 23538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:44695
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab.
Entry for principal oryx/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab.
I20260923 14:41:07.116259 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44463
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:07.222919 23734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:07.223134 23734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:07.223174 23734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:07.227126 23734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:07.227180 23734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:07.227236 23734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:07.232347 23734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:07.233287 23734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:07.234247 23734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:07.243636 23740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.243636 23742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.243705 23734 server_base.cc:1034] running on GCE node
W20260923 14:41:07.243654 23739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.244277 23734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:07.245002 23734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:07.246169 23734 hybrid_clock.cc:648] HybridClock initialized: now 1790174467246156 us; error 29 us; skew 500 ppm
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:07.248833 23734 init.cc:377] Logged in from keytab as oryx/127.17.4.130@KRBTEST.COM (short username oryx)
I20260923 14:41:07.249656 23734 webserver.cc:460] Webserver started at http://127.17.4.130:36311/ using document root <none> and password file <none>
I20260923 14:41:07.250151 23734 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:07.250208 23734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:07.250379 23734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:07.252341 23734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "16734ba172984ae68335d86eab1b3f22"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "11c5b089128244a15a65a6f0b2ed0478"
server_key_iv: "785dd4f0db037802fd411f45c3d43058"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.252830 23734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "16734ba172984ae68335d86eab1b3f22"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "11c5b089128244a15a65a6f0b2ed0478"
server_key_iv: "785dd4f0db037802fd411f45c3d43058"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.256896 23734 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 14:41:07.259197 23749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.260492 23734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:07.260587 23734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "16734ba172984ae68335d86eab1b3f22"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "11c5b089128244a15a65a6f0b2ed0478"
server_key_iv: "785dd4f0db037802fd411f45c3d43058"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.260667 23734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:07.275020 23734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:07.277776 23734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:07.277918 23734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:07.278410 23734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:07.279135 23734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:07.279179 23734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.279217 23734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:07.279232 23734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.287905 23734 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:44717
I20260923 14:41:07.287928 23862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:44717 every 8 connection(s)
I20260923 14:41:07.288741 23734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:07.291605 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23734
I20260923 14:41:07.291723 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:07.292104 17426 external_mini_cluster.cc:1428] Setting key 3bef9aa338a86e8b704f8cda98c72e52
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:41:07.302665 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.290404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:51493 (local address 127.17.4.190:44463)
0923 14:41:07.290566 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.290571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.291417 (+ 846us) server_negotiation.cc:407] Connection header received
0923 14:41:07.293031 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.293034 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.293087 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.293191 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.294622 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.295130 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.296368 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.296609 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.296722 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.299172 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.299176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.299179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.299208 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.300847 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.301311 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.301315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.301317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.301404 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.301755 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.301761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.301765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.301935 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.302012 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.302440 (+ 428us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.302536 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:41:07.303536 23865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.290808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:51493)
0923 14:41:07.291254 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.291293 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.292828 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.293349 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.293355 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.293795 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.294456 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.294477 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.295262 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.295266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.296239 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.296250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.296767 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.296771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.296939 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.297512 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.297547 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.299010 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.300961 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.300965 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.300975 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.301205 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.301523 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.301527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.301538 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.301658 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.302022 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.302026 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.302221 (+ 195us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.302359 (+ 138us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.302691 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.131@KRBTEST.COM" created.
I20260923 14:41:07.304804 23863 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44463
I20260923 14:41:07.305033 23863 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:07.305471 23863 heartbeater.cc:511] Master 127.17.4.190:44463 requested a full tablet report, sending...
I20260923 14:41:07.306489 23538 ts_manager.cc:194] Registered new tserver with Master: 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717)
I20260923 14:41:07.307305 23538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:51493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab.
Entry for principal oryx/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab.
I20260923 14:41:07.318532 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44463
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:07.422232 23868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:07.422465 23868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:07.422536 23868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:07.426903 23868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:07.426959 23868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:07.427016 23868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:07.432376 23868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:07.433336 23868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:07.434325 23868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:07.443670 23876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.443665 23873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.443827 23868 server_base.cc:1034] running on GCE node
W20260923 14:41:07.443845 23874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.444414 23868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:07.445000 23868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:07.446198 23868 hybrid_clock.cc:648] HybridClock initialized: now 1790174467446169 us; error 43 us; skew 500 ppm
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:07.448885 23868 init.cc:377] Logged in from keytab as oryx/127.17.4.131@KRBTEST.COM (short username oryx)
I20260923 14:41:07.449622 23868 webserver.cc:460] Webserver started at http://127.17.4.131:39141/ using document root <none> and password file <none>
I20260923 14:41:07.450140 23868 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:07.450192 23868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:07.450338 23868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:07.452296 23868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "786dedf7a34e45118f0ff8c612ce4dea"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "1d3a98756eb5f40a25caa972eb3bd116"
server_key_iv: "362ad59a849f3ef8e9ba4e1e6ef339af"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.452801 23868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "786dedf7a34e45118f0ff8c612ce4dea"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "1d3a98756eb5f40a25caa972eb3bd116"
server_key_iv: "362ad59a849f3ef8e9ba4e1e6ef339af"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.456178 23868 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:41:07.458254 23883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.459446 23868 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:07.459625 23868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "786dedf7a34e45118f0ff8c612ce4dea"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "1d3a98756eb5f40a25caa972eb3bd116"
server_key_iv: "362ad59a849f3ef8e9ba4e1e6ef339af"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.459703 23868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:07.496129 23868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:07.498822 23868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:07.498956 23868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:07.499410 23868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:07.500124 23868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:07.500169 23868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.500205 23868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:07.500229 23868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.508484 23868 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:40079
I20260923 14:41:07.508515 23996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:40079 every 8 connection(s)
I20260923 14:41:07.509255 23868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:07.514093 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 23868
I20260923 14:41:07.514258 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:07.514613 17426 external_mini_cluster.cc:1428] Setting key 3710b25f449fde200fe08358c111fb3c
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:07.522065 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.510768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:52377 (local address 127.17.4.190:44463)
0923 14:41:07.510892 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.510896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.511655 (+ 759us) server_negotiation.cc:407] Connection header received
0923 14:41:07.513012 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.513015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.513073 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.513185 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.514333 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.515056 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.516431 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.516740 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.516852 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.519088 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.519091 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.519093 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.519117 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.520464 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.520908 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.520910 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.520912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.520977 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.521242 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.521244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.521245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.521392 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.521461 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.521864 (+ 403us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.521953 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:41:07.522740 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.511107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:52377)
0923 14:41:07.511494 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.511560 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.512811 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.513340 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.513346 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.513648 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.514144 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.514156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.515159 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.515163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.516314 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.516323 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.516882 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.516886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.517052 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.517500 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.517515 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.518937 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.520566 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.520570 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.520580 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.520825 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.521052 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.521054 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.521055 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.521169 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.521474 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.521478 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.521675 (+ 197us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.521813 (+ 138us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.522024 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":104,"threads_started":1}
I20260923 14:41:07.523727 23997 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44463
I20260923 14:41:07.523941 23997 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:07.524331 23997 heartbeater.cc:511] Master 127.17.4.190:44463 requested a full tablet report, sending...
I20260923 14:41:07.525216 23538 ts_manager.cc:194] Registered new tserver with Master: 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079)
I20260923 14:41:07.525733 23538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:52377
I20260923 14:41:07.528308 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.4.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.189.keytab.
Entry for principal oryx/127.17.4.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.189.keytab.
I20260923 14:41:07.554054 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:36151
--webserver_interface=127.17.4.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.189.keytab
--principal=oryx/127.17.4.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44463,127.17.4.189:36151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:07.662438 24002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:07.662742 24002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:07.662820 24002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:07.666975 24002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:07.667045 24002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:07.667080 24002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:07.667114 24002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:07.667169 24002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:07.672031 24002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44463,127.17.4.189:36151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.189.keytab
--principal=oryx/127.17.4.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:36151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.4.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
W20260923 14:41:07.672246 24002 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.4.190:44463,127.17.4.189:36151'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260923 14:41:07.672989 24002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:07.673946 24002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:07.681849 24010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.681854 24007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.681862 24008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.682047 24002 server_base.cc:1034] running on GCE node
I20260923 14:41:07.682564 24002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:07.683593 24002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:07.684770 24002 hybrid_clock.cc:648] HybridClock initialized: now 1790174467684759 us; error 57 us; skew 500 ppm
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:07.687381 24002 init.cc:377] Logged in from keytab as oryx/127.17.4.189@KRBTEST.COM (short username oryx)
I20260923 14:41:07.688198 24002 webserver.cc:460] Webserver started at http://127.17.4.189:45355/ using document root <none> and password file <none>
I20260923 14:41:07.688669 24002 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:07.688751 24002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:07.688949 24002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:07.690793 24002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/instance:
uuid: "8751807ba13b419e809a868d7c68c8a2"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "7a034ce8fe3bf44d53d1c7a2a817f892"
server_key_iv: "6bec5d2f1cae8b9bd6badd4ba96eab56"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.691473 24002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal/instance:
uuid: "8751807ba13b419e809a868d7c68c8a2"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "7a034ce8fe3bf44d53d1c7a2a817f892"
server_key_iv: "6bec5d2f1cae8b9bd6badd4ba96eab56"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.695122 24002 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:41:07.697387 24017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.698561 24002 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:07.698683 24002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
uuid: "8751807ba13b419e809a868d7c68c8a2"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "7a034ce8fe3bf44d53d1c7a2a817f892"
server_key_iv: "6bec5d2f1cae8b9bd6badd4ba96eab56"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.698781 24002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:07.710438 24002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:07.713243 24002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:07.713449 24002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:07.719954 24002 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.189:36151
I20260923 14:41:07.720250 24069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.189:36151 every 8 connection(s)
I20260923 14:41:07.720891 24002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
I20260923 14:41:07.723354 24070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:07.726842 24070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:41:07.729079 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 24002
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.189@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
I20260923 14:41:07.741389 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.728780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35570 (local address 127.17.4.190:44463)
0923 14:41:07.729004 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.729010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.729794 (+ 784us) server_negotiation.cc:407] Connection header received
0923 14:41:07.730810 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.730815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.730861 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.730954 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.732100 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.732920 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.734263 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.734630 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.734736 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.737347 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.737350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.737352 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.737373 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.739110 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.739704 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.739709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.739713 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.739827 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.740204 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.740207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.740208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.740518 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.740590 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.741080 (+ 490us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.741210 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260923 14:41:07.742290 24074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.730056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39066 (local address 127.17.4.189:36151)
0923 14:41:07.730348 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.730358 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.730397 (+ 39us) server_negotiation.cc:407] Connection header received
0923 14:41:07.730635 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.730653 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.730867 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.731051 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.731977 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.733208 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.734263 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.734843 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.734921 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.737831 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.737835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.737862 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.737888 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.739653 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.740107 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.740112 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.740114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.740193 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.740449 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.740451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.740452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.740870 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.741058 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.741272 (+ 214us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.741381 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"spinlock_wait_cycles":3712,"thread_start_us":108,"threads_started":1}
I20260923 14:41:07.742290 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.729173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:35570)
0923 14:41:07.729653 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.729702 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.730625 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.731105 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.731112 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.731590 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.731963 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.731980 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.733038 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.733041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.734136 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.734147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.734769 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.734772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.734924 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.735542 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.735582 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.737203 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.739236 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.739243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.739250 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.739589 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.739942 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.739945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.739946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.740107 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.740611 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.740616 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.740866 (+ 250us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.741035 (+ 169us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.741344 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":27,"thread_start_us":122,"threads_started":1}
I20260923 14:41:07.743597 24070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.189@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
I20260923 14:41:07.750569 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.744075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39082)
0923 14:41:07.744202 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.744213 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.744276 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.744573 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.744577 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.744735 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.744818 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.744823 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.745551 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.745554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.746073 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.746079 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.746543 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.746546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.746679 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.747120 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.747132 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.748241 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.749531 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.749534 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.749535 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.749699 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.749891 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.749893 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.749894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.749953 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.750234 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.750236 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.750298 (+ 62us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.750366 (+ 68us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.750442 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":17}
I20260923 14:41:07.750591 24074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.744143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.17.4.189:36151)
0923 14:41:07.744239 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.744242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.744252 (+ 10us) server_negotiation.cc:407] Connection header received
0923 14:41:07.744418 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.744421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.744460 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.744530 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.744941 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.745430 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.746193 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.746420 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.746536 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.748360 (+ 1824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.748363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.748365 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.748383 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.749447 (+ 1064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.749769 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.749770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.749771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.749827 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.750015 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.750017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.750018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.750167 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.750230 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.750412 (+ 182us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.750484 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":36}
I20260923 14:41:07.753294 24070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Bootstrap starting.
I20260923 14:41:07.755362 24070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:07.756078 24070 log.cc:824] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:07.757658 24070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: No bootstrap required, opened a new log
I20260923 14:41:07.760444 24070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } }
I20260923 14:41:07.760602 24070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:07.760673 24070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8751807ba13b419e809a868d7c68c8a2, State: Initialized, Role: FOLLOWER
I20260923 14:41:07.761030 24070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } }
I20260923 14:41:07.761410 24076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } } }
I20260923 14:41:07.761505 24076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:07.762012 24070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 14:41:07.766438 24087 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:41:07.766515 24087 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:41:07.768237 24002 master_runner.cc:428] Detected that this master 8751807ba13b419e809a868d7c68c8a2 is joining an existing cluster
I20260923 14:41:07.768302 24002 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.4.189:36151
I20260923 14:41:07.778254 24074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.770627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39092 (local address 127.17.4.189:36151)
0923 14:41:07.770724 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.770728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.771028 (+ 300us) server_negotiation.cc:407] Connection header received
0923 14:41:07.771134 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.771137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.771175 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.771250 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.771706 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.772383 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.773194 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.773452 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.773552 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.774652 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.774657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.774661 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.774686 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.776479 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.777010 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.777014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.777016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.777082 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.777384 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.777387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.777389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.777590 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.777696 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.777970 (+ 274us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.778102 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":40,"spinlock_wait_cycles":2688}
I20260923 14:41:07.778267 24094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.770705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39092)
0923 14:41:07.770950 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.770961 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.771062 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.771262 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.771264 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.771478 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.771570 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.771576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.772487 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.772489 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.773086 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.773092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.773551 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.773554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.773639 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.774125 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.774139 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.774511 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.776676 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.776678 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.776681 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.776907 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.777179 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.777184 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.777185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.777264 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.777731 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.777735 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.777828 (+ 93us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.777926 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.778055 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":39,"thread_start_us":94,"threads_started":1}
I20260923 14:41:07.778915 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.770057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:35580)
0923 14:41:07.770489 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.770503 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.770644 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.770999 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.771002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.771196 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.771329 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.771336 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.772421 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.772426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.773444 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.773454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.774147 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.774150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.774239 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.774703 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.774718 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.775115 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.777216 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.777220 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.777222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.777554 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.777872 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.777874 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.777876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.777965 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.778440 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.778442 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.778523 (+ 81us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.778632 (+ 109us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.778752 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":31,"thread_start_us":227,"threads_started":1}
I20260923 14:41:07.779008 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.770165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35580 (local address 127.17.4.190:44463)
0923 14:41:07.770293 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.770298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.770580 (+ 282us) server_negotiation.cc:407] Connection header received
0923 14:41:07.770749 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.770753 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.770797 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.770845 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.771458 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.772312 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.773599 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.773928 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.774000 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.775242 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.775246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.775251 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.775281 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.777105 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.777679 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.777683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.777685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.777777 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.778078 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.778081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.778083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.778285 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.778355 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.778734 (+ 379us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.778839 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.190@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
I20260923 14:41:07.793004 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.783241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39100)
0923 14:41:07.784035 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.784082 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.784210 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.784542 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.784548 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.784959 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.785077 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.785084 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.786033 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.786036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.787007 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.787017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.787565 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.787568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.787666 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.788165 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.788178 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.789762 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.791516 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.791524 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.791530 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.791807 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.792047 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.792050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.792052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.792134 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.792490 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.792495 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.792597 (+ 102us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.792717 (+ 120us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.792864 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":86,"threads_started":1}
I20260923 14:41:07.793015 24074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.783291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39100 (local address 127.17.4.189:36151)
0923 14:41:07.783384 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.783388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.784166 (+ 778us) server_negotiation.cc:407] Connection header received
0923 14:41:07.784334 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.784355 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.784402 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.784481 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.785194 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.785929 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.787134 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.787448 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.787537 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.789926 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.789930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.789932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.789954 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.791413 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.791883 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.791887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.791888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.791962 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.792224 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.792227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.792228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.792399 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.792483 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.792795 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.792888 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 14:41:07.794623 23538 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.4.189:36151: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8751807ba13b419e809a868d7c68c8a2"
member_type: NON_VOTER
last_known_addr {
host: "127.17.4.189"
port: 36151
}
attrs {
promote: true
}
}
dest_uuid: "108d5270212a410c9d51bfb74d86c98f"
cas_config_opid_index: -1
I20260923 14:41:07.795238 23538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } }
I20260923 14:41:07.796983 24096 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 8751807ba13b419e809a868d7c68c8a2 (127.17.4.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } }
I20260923 14:41:07.797637 24044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:07.798730 24044 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Refusing update from remote peer 108d5270212a410c9d51bfb74d86c98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260923 14:41:07.798763 24096 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.4.189:36151
I20260923 14:41:07.798938 24096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } }
I20260923 14:41:07.799029 24096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:07.799292 24002 master.cc:537] Master@127.17.4.189:36151 shutting down...
I20260923 14:41:07.799454 24097 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 14:41:07.802103 23525 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260923 14:41:07.802942 23525 consensus_peers.cc:487] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f -> Peer 8751807ba13b419e809a868d7c68c8a2 (127.17.4.189:36151): Couldn't send request to peer 8751807ba13b419e809a868d7c68c8a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260923 14:41:07.803452 24002 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:07.803704 24002 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:07.803831 24002 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: stopping tablet replica
WARNING: no policy specified for oryx/127.17.4.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.188@KRBTEST.COM" created.
I20260923 14:41:07.817919 24002 master.cc:552] Master@127.17.4.189:36151 shutdown complete.
I20260923 14:41:07.817979 24002 master_runner.cc:305] Clearing existing system tablet
I20260923 14:41:07.818212 24002 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:07.818280 24002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:07.819411 24002 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:07.820303 24103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.820493 24002 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:07.820623 24002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260923 14:41:07.820679 24002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
uuid: "8751807ba13b419e809a868d7c68c8a2"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "7a034ce8fe3bf44d53d1c7a2a817f892"
server_key_iv: "6bec5d2f1cae8b9bd6badd4ba96eab56"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.822350 24002 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:07.824786 24002 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 14:41:07.824883 24002 log.cc:1196] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260923 14:41:07.825162 24002 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Deleting consensus metadata
I20260923 14:41:07.825798 24002 master_runner.cc:315] Copying system tablet from 127.17.4.190:44463
I20260923 14:41:07.826793 24002 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: tablet copy: Beginning tablet copy session from remote peer at address 127.17.4.190:44463
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.188.keytab.
Entry for principal oryx/127.17.4.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.188.keytab.
I20260923 14:41:07.829030 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:35327
--webserver_interface=127.17.4.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.188.keytab
--principal=oryx/127.17.4.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:41:07.834828 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.827326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.17.4.190:44463)
0923 14:41:07.827456 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:07.827461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:07.827584 (+ 123us) server_negotiation.cc:407] Connection header received
0923 14:41:07.827724 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:07.827728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:07.827820 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:07.827907 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:07.828380 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.829164 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.830405 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.830638 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.830742 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.831824 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:07.831828 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:07.831830 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:07.831853 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:07.833253 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.833674 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.833679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.833680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.833756 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:07.834026 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:07.834029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:07.834031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:07.834197 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:07.834298 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:07.834565 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 14:41:07.834677 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:41:07.834841 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:07.827281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:35582)
0923 14:41:07.827493 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:07.827507 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:07.827612 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:07.827923 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:07.827926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:07.828140 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:07.828281 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.828289 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.829295 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.829301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.830280 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:07.830291 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:07.830744 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:07.830747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:07.830837 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:07.831359 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:07.831379 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:07.831666 (+ 287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:07.833375 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.833378 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.833380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.833575 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.833849 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:07.833852 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:07.833853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:07.833933 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:07.834287 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:07.834290 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:07.834409 (+ 119us) client_negotiation.cc:769] Sending connection context
0923 14:41:07.834516 (+ 107us) client_negotiation.cc:240] Negotiation successful
0923 14:41:07.834649 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":76,"threads_started":1}
I20260923 14:41:07.835636 23558 tablet_copy_service.cc:140] P 108d5270212a410c9d51bfb74d86c98f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8751807ba13b419e809a868d7c68c8a2 ({username='oryx', principal='oryx/127.17.4.189@KRBTEST.COM'} at 127.0.0.1:35582)
I20260923 14:41:07.835829 23558 tablet_copy_service.cc:161] P 108d5270212a410c9d51bfb74d86c98f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8751807ba13b419e809a868d7c68c8a2 at {username='oryx', principal='oryx/127.17.4.189@KRBTEST.COM'} at 127.0.0.1:35582: session id = 8751807ba13b419e809a868d7c68c8a2-00000000000000000000000000000000
I20260923 14:41:07.837153 23558 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 14:41:07.838471 24002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 14:41:07.840284 24002 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: tablet copy: Starting download of 0 data blocks...
I20260923 14:41:07.840508 24002 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: tablet copy: Starting download of 1 WAL segments...
I20260923 14:41:07.841928 24002 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 14:41:07.843349 23558 tablet_copy_service.cc:342] P 108d5270212a410c9d51bfb74d86c98f: Request end of tablet copy session 8751807ba13b419e809a868d7c68c8a2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.4.189@KRBTEST.COM'} at 127.0.0.1:35582
I20260923 14:41:07.843453 23558 tablet_copy_service.cc:433] P 108d5270212a410c9d51bfb74d86c98f: ending tablet copy session 8751807ba13b419e809a868d7c68c8a2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8751807ba13b419e809a868d7c68c8a2
I20260923 14:41:07.849870 24002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:07.851507 24114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.851599 24002 server_base.cc:1034] running on GCE node
W20260923 14:41:07.851508 24111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.851961 24112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.852173 24002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:07.852461 24002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:07.853587 24002 hybrid_clock.cc:648] HybridClock initialized: now 1790174467853576 us; error 26 us; skew 500 ppm
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:07.854936 24002 init.cc:377] Logged in from keytab as oryx/127.17.4.189@KRBTEST.COM (short username oryx)
I20260923 14:41:07.855371 24002 webserver.cc:460] Webserver started at http://127.17.4.189:38195/ using document root <none> and password file <none>
I20260923 14:41:07.855556 24002 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:07.855630 24002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:07.856659 24002 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:07.857443 24121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:07.857707 24002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:07.857798 24002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
uuid: "8751807ba13b419e809a868d7c68c8a2"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "7a034ce8fe3bf44d53d1c7a2a817f892"
server_key_iv: "6bec5d2f1cae8b9bd6badd4ba96eab56"
server_key_version: "encryptionkey@0"
I20260923 14:41:07.857872 24002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:07.883853 24002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:07.885711 24002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:07.890039 24002 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.189:36151
I20260923 14:41:07.890306 24173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.189:36151 every 8 connection(s)
I20260923 14:41:07.890678 24002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
I20260923 14:41:07.891952 24174 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:41:07.892653 24174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Bootstrap starting.
I20260923 14:41:07.900012 24174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:41:07.900303 24174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Bootstrap complete.
I20260923 14:41:07.900751 24174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } }
I20260923 14:41:07.900874 24174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8751807ba13b419e809a868d7c68c8a2, State: Initialized, Role: LEARNER
I20260923 14:41:07.901002 24174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } }
I20260923 14:41:07.901297 24177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } }
I20260923 14:41:07.901441 24177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: LEARNER
I20260923 14:41:07.901453 24174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:07.904182 24188 catalog_manager.cc:1259] Loaded cluster ID: 4f47fb55797546218928f2bd443ab036
I20260923 14:41:07.904270 24188 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: loading cluster ID for follower catalog manager: success
I20260923 14:41:07.905897 24188 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: acquiring CA information for follower catalog manager: success
I20260923 14:41:07.907020 24188 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 14:41:07.972090 24110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:07.972307 24110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:07.972343 24110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:07.976155 24110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:07.976198 24110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:07.976217 24110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:07.976233 24110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:07.976246 24110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:07.981107 24110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.188.keytab
--principal=oryx/127.17.4.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:35327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.4.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:07.981961 24110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:07.982810 24110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:07.990362 24194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.990374 24196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:07.990393 24193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:07.990549 24110 server_base.cc:1034] running on GCE node
I20260923 14:41:07.991299 24110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:07.992328 24110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:07.993476 24110 hybrid_clock.cc:648] HybridClock initialized: now 1790174467993453 us; error 32 us; skew 500 ppm
Sep 23 14:41:07 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:07.999353 24110 init.cc:377] Logged in from keytab as oryx/127.17.4.188@KRBTEST.COM (short username oryx)
I20260923 14:41:08.000195 24110 webserver.cc:460] Webserver started at http://127.17.4.188:42527/ using document root <none> and password file <none>
I20260923 14:41:08.000705 24110 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:08.000787 24110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:08.000998 24110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:08.003332 24110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/instance:
uuid: "2084552ab4e540cfa29b64a77316f860"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "46b4bfcc0d8f6c89bf5948791482a8d4"
server_key_iv: "ea20a9f4e3f6b3ca4edf0abab516991f"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.003921 24110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal/instance:
uuid: "2084552ab4e540cfa29b64a77316f860"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "46b4bfcc0d8f6c89bf5948791482a8d4"
server_key_iv: "ea20a9f4e3f6b3ca4edf0abab516991f"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.007562 24110 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:41:08.009800 24203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.010926 24110 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:08.011078 24110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
uuid: "2084552ab4e540cfa29b64a77316f860"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "46b4bfcc0d8f6c89bf5948791482a8d4"
server_key_iv: "ea20a9f4e3f6b3ca4edf0abab516991f"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.011189 24110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:08.020797 24110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:08.023285 24110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:08.023451 24110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:08.029469 24110 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.188:35327
I20260923 14:41:08.029743 24255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.188:35327 every 8 connection(s)
I20260923 14:41:08.030344 24110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
I20260923 14:41:08.032862 24256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:08.035458 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 24110
I20260923 14:41:08.036592 24256 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.188@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.4.188@KRBTEST.COM
I20260923 14:41:08.048316 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.038445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35596 (local address 127.17.4.190:44463)
0923 14:41:08.038582 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.038588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.038770 (+ 182us) server_negotiation.cc:407] Connection header received
0923 14:41:08.038960 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.038969 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.039014 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.039057 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.039915 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.040695 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.041760 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.041987 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.042072 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.044662 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.044668 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.044670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.044698 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.046320 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.046829 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.046833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.046835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.046936 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.047274 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.047278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.047280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.047454 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.047558 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.048045 (+ 487us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.048165 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:41:08.049075 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.038300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:35596)
0923 14:41:08.038655 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.038698 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.038849 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.039197 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.039201 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.039492 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.039727 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.039737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.040855 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.040858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.041633 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.041641 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.042133 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.042137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.042350 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.043005 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.043018 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.044513 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.046424 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.046431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.046439 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.046753 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.047028 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.047033 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.047035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.047171 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.047565 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.047574 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.047837 (+ 263us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.048001 (+ 164us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.048274 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":69,"spinlock_wait_cycles":5760,"thread_start_us":142,"threads_started":1}
I20260923 14:41:08.049083 24258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.036806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59438 (local address 127.17.4.188:35327)
0923 14:41:08.037199 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.037216 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.037255 (+ 39us) server_negotiation.cc:407] Connection header received
0923 14:41:08.038051 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.038067 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.038372 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.038743 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.039489 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.040976 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.041787 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.042164 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.042353 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.045097 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.045102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.045110 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.045131 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.046656 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.047083 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.047089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.047091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.047175 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.047451 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.047455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.047456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.047828 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.048019 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.048250 (+ 231us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.048475 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":271,"thread_start_us":126,"threads_started":1}
I20260923 14:41:08.050187 24256 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.188@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
I20260923 14:41:08.057750 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.050635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39108)
0923 14:41:08.050762 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.050774 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.050836 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.051262 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.051264 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.051379 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.051454 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.051458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.052464 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.052466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.052952 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.052958 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.053344 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.053347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.053411 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.053762 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.053772 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.054909 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.056685 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.056687 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.056688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.056848 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.057069 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.057071 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.057072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.057136 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.057428 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.057429 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.057501 (+ 72us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.057572 (+ 71us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.057658 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 14:41:08.057865 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.050752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39108 (local address 127.17.4.189:36151)
0923 14:41:08.051034 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.051039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.051052 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:08.051094 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.051097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.051147 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.051229 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.051597 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.052370 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.053043 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.053260 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.053333 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.055034 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.055037 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.055039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.055061 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.056592 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.056924 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.056926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.056927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.056995 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.057207 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.057209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.057210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.057355 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.057423 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.057619 (+ 196us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.057706 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
I20260923 14:41:08.058485 24256 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174467, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.188@KRBTEST.COM for oryx/127.17.4.188@KRBTEST.COM
I20260923 14:41:08.065394 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.058854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.0.0.1:59440)
0923 14:41:08.058959 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.058973 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.059062 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.059268 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.059270 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.059378 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.059465 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.059471 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.060248 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.060250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.060678 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.060684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.061075 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.061077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.061154 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.061478 (+ 324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.061487 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.062485 (+ 998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.064204 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.064207 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.064208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.064376 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.064640 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.064643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.064644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.064748 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.065047 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.065048 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.065120 (+ 72us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.065198 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.065277 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":14}
I20260923 14:41:08.065495 24258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.058919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59440 (local address 127.17.4.188:35327)
0923 14:41:08.059010 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.059014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.059047 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:41:08.059153 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.059155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.059185 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.059245 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.059568 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.060161 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.060780 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.060989 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.061071 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.062626 (+ 1555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.062629 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.062630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.062649 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.064109 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.064481 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.064483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.064485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.064552 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.064833 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.064835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.064836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.064970 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.065049 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.065250 (+ 201us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.065327 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":38}
I20260923 14:41:08.068337 24256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Bootstrap starting.
I20260923 14:41:08.070393 24256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:08.071064 24256 log.cc:824] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:08.072715 24256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: No bootstrap required, opened a new log
I20260923 14:41:08.075433 24256 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } }
I20260923 14:41:08.075654 24256 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:08.075731 24256 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2084552ab4e540cfa29b64a77316f860, State: Initialized, Role: FOLLOWER
I20260923 14:41:08.076146 24256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } }
I20260923 14:41:08.076570 24262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } } }
I20260923 14:41:08.076671 24262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:08.077200 24256 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 14:41:08.081403 24273 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:41:08.081485 24273 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:41:08.084525 24110 master_runner.cc:428] Detected that this master 2084552ab4e540cfa29b64a77316f860 is joining an existing cluster
I20260923 14:41:08.084589 24110 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.4.188:35327
I20260923 14:41:08.102213 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23600
I20260923 14:41:08.105866 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.086893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35598 (local address 127.17.4.190:44463)
0923 14:41:08.087095 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.087099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.087525 (+ 426us) server_negotiation.cc:407] Connection header received
0923 14:41:08.087694 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.087698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.087749 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.087822 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.088491 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.089291 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.090611 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.090916 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.090984 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.092312 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.092317 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.092320 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.092343 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.093659 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.104339 (+ 10680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.104346 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.104350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.104464 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.104791 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.104797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.104802 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.105041 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.105129 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.105493 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.105634 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260923 14:41:08.107451 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.087177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:35598)
0923 14:41:08.087449 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.087463 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.087584 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.087968 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.087971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.088205 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.088364 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.088374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.089411 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.089415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.090467 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.090477 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.091148 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.091151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.091231 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.091699 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.091716 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.092173 (+ 457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.093806 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.093808 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.093810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.104211 (+ 10401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.104583 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.104588 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.104593 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.104691 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.105203 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.105209 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.105315 (+ 106us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.106227 (+ 912us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.107282 (+ 1055us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":69,"thread_start_us":104,"threads_started":1}
I20260923 14:41:08.108506 24279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.086565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.0.0.1:59444)
0923 14:41:08.086801 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.086817 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.086900 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.088275 (+ 1375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.088278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.088476 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.088571 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.088577 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.089491 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.089495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.090481 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.090494 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.091108 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.091111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.091196 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.104167 (+ 12971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.104181 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.104617 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.106551 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.106553 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.106555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.106900 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.107213 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.107219 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.107223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.107302 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.107705 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.107710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.107819 (+ 109us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.107911 (+ 92us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.108227 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":68,"spinlock_wait_cycles":35200,"thread_start_us":101,"threads_started":1}
I20260923 14:41:08.108760 24258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.087048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59444 (local address 127.17.4.188:35327)
0923 14:41:08.088084 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.088090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.088101 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:08.088126 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.088128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.088167 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.088669 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.088729 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.089378 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.090610 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.090913 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.091001 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.104760 (+ 13759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.104764 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.104766 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.104786 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.106440 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.107011 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.107017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.107022 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.107105 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.107384 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.107390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.107394 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.107588 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.107672 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.108131 (+ 459us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.108610 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":364,"server-negotiator.queue_time_us":978}
I20260923 14:41:08.109539 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:32871
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:44463
--webserver_port=46795
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:41:08.112709 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.087576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39116 (local address 127.17.4.189:36151)
0923 14:41:08.087702 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.087706 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.089648 (+ 1942us) server_negotiation.cc:407] Connection header received
0923 14:41:08.089812 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.089815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.089857 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.089902 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.090730 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.091399 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.092538 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.093357 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.093461 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.107807 (+ 14346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.107811 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.107814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.107839 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.110568 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.111290 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.111294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.111296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.111380 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.111861 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.111865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.111866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.112074 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.112150 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.112443 (+ 293us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.112566 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:41:08.113301 24281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.087823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39116)
0923 14:41:08.089571 (+ 1748us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.089583 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.089716 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.090018 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.090021 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.090192 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.090623 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.090630 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.091516 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.091518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.092416 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.092425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.093481 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.093485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.093599 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.094042 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.094052 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.107184 (+ 13132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.110689 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.110692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.110694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.110916 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.111635 (+ 719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.111638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.111640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.111729 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.112204 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.112207 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.112282 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.112981 (+ 699us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.113141 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1692,"thread_start_us":83,"threads_started":1}
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174466, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.190@KRBTEST.COM for oryx/127.17.4.188@KRBTEST.COM
I20260923 14:41:08.122550 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.112727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.0.0.1:59446)
0923 14:41:08.112900 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.112914 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.112987 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.113344 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.113347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.113545 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.113678 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.113688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.115016 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.115021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.116065 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.116077 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.116642 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.116648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.116770 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.117225 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.117244 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.118843 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.120913 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.120916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.120919 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.121168 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.121497 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.121500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.121502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.121597 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.122061 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.122064 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.122158 (+ 94us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.122264 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.122397 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260923 14:41:08.122596 24258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.112774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59446 (local address 127.17.4.188:35327)
0923 14:41:08.113145 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.113148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.113157 (+ 9us) server_negotiation.cc:407] Connection header received
0923 14:41:08.113204 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.113206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.113241 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.113328 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.114132 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.114879 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.116183 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.116510 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.116614 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.118982 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.118989 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.118994 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.119024 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.120795 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.121291 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.121296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.121301 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.121390 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.121700 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.121706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.121709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.121939 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.122056 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.122346 (+ 290us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.122464 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309}
I20260923 14:41:08.123869 23538 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.4.188:35327: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2084552ab4e540cfa29b64a77316f860"
member_type: NON_VOTER
last_known_addr {
host: "127.17.4.188"
port: 35327
}
attrs {
promote: true
}
}
dest_uuid: "108d5270212a410c9d51bfb74d86c98f"
cas_config_opid_index: 5
I20260923 14:41:08.124470 23538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } }
I20260923 14:41:08.125474 24096 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2084552ab4e540cfa29b64a77316f860 (127.17.4.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.125932 24230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:08.126875 24096 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.4.188:35327
I20260923 14:41:08.127045 24096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.127131 24096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.127204 24230 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Refusing update from remote peer 108d5270212a410c9d51bfb74d86c98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260923 14:41:08.127978 24097 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:08.128064 24110 master.cc:537] Master@127.17.4.188:35327 shutting down...
W20260923 14:41:08.129896 23523 consensus_peers.cc:487] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f -> Peer 2084552ab4e540cfa29b64a77316f860 (127.17.4.188:35327): Couldn't send request to peer 2084552ab4e540cfa29b64a77316f860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260923 14:41:08.134954 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.127471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39130)
0923 14:41:08.130712 (+ 3241us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.130725 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.130802 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.131183 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.131186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.131201 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.131274 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.131279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.132255 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.132258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.133482 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.133492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.134579 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.134583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.134673 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.134715 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.134780 (+ 65us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.134841 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3179}
I20260923 14:41:08.135340 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.127883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39130 (local address 127.17.4.189:36151)
0923 14:41:08.130629 (+ 2746us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.130633 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.130890 (+ 257us) server_negotiation.cc:407] Connection header received
0923 14:41:08.130929 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.130932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.130985 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.131074 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.131381 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.132132 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.133619 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.134252 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.134325 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.134484 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.135160 (+ 676us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.135230 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2668}
I20260923 14:41:08.135794 24148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 LEARNER]: Refusing update from remote peer 108d5270212a410c9d51bfb74d86c98f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260923 14:41:08.136343 24097 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 14:41:08.138070 24148 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2084552ab4e540cfa29b64a77316f860 (127.17.4.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.140261 24097 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: attempting to promote NON_VOTER 8751807ba13b419e809a868d7c68c8a2 to VOTER
I20260923 14:41:08.140210 24177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 108d5270212a410c9d51bfb74d86c98f. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.140555 24177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: LEARNER
I20260923 14:41:08.140636 24097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } }
I20260923 14:41:08.140697 24177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: NON_VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: true } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.140774 24177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: LEARNER
I20260923 14:41:08.141739 24148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 LEARNER]: Refusing update from remote peer 108d5270212a410c9d51bfb74d86c98f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260923 14:41:08.142071 24096 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260923 14:41:08.142323 23523 consensus_peers.cc:487] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f -> Peer 2084552ab4e540cfa29b64a77316f860 (127.17.4.188:35327): Couldn't send request to peer 2084552ab4e540cfa29b64a77316f860. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260923 14:41:08.142771 24110 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:08.143018 24110 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:08.143131 24110 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: stopping tablet replica
I20260923 14:41:08.143524 24096 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8751807ba13b419e809a868d7c68c8a2 (127.17.4.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.144925 24096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.145038 24096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.145160 24096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.145254 24096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.146634 24148 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8751807ba13b419e809a868d7c68c8a2 (127.17.4.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.147882 24284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.148005 24284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:08.158154 24110 master.cc:552] Master@127.17.4.188:35327 shutdown complete.
I20260923 14:41:08.158241 24110 master_runner.cc:305] Clearing existing system tablet
I20260923 14:41:08.158475 24110 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:08.158526 24110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:08.159828 24110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:08.160669 24288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.160884 24110 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:08.161003 24110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:08.161051 24110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
uuid: "2084552ab4e540cfa29b64a77316f860"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "46b4bfcc0d8f6c89bf5948791482a8d4"
server_key_iv: "ea20a9f4e3f6b3ca4edf0abab516991f"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.162791 24110 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:08.165048 24110 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 14:41:08.165131 24110 log.cc:1196] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260923 14:41:08.165364 24110 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Deleting consensus metadata
I20260923 14:41:08.165522 24110 master_runner.cc:315] Copying system tablet from 127.17.4.190:44463
I20260923 14:41:08.166561 24110 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: tablet copy: Beginning tablet copy session from remote peer at address 127.17.4.190:44463
I20260923 14:41:08.174896 24294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.167007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:35612)
0923 14:41:08.167276 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.167289 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.167391 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.167632 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.167635 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.167915 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.168050 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.168058 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.169044 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.169048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.169906 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.169917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.170493 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.170496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.170588 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.171127 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.171140 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.171544 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.173417 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.173420 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.173422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.173654 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.173922 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.173924 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.173926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.174009 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.174390 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.174393 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.174481 (+ 88us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.174585 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.174718 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":75,"threads_started":1}
I20260923 14:41:08.174911 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.167091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35612 (local address 127.17.4.190:44463)
0923 14:41:08.167196 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.167200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.167367 (+ 167us) server_negotiation.cc:407] Connection header received
0923 14:41:08.167465 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.167468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.167510 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.167595 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.168170 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.168929 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.170034 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.170385 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.170476 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.171678 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.171682 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.171684 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.171707 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.173309 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.173751 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.173754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.173756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.173835 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.174096 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.174099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.174101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.174281 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.174389 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.174655 (+ 266us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.174767 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:41:08.175674 23558 tablet_copy_service.cc:140] P 108d5270212a410c9d51bfb74d86c98f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2084552ab4e540cfa29b64a77316f860 ({username='oryx', principal='oryx/127.17.4.188@KRBTEST.COM'} at 127.0.0.1:35612)
I20260923 14:41:08.175758 23558 tablet_copy_service.cc:161] P 108d5270212a410c9d51bfb74d86c98f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2084552ab4e540cfa29b64a77316f860 at {username='oryx', principal='oryx/127.17.4.188@KRBTEST.COM'} at 127.0.0.1:35612: session id = 2084552ab4e540cfa29b64a77316f860-00000000000000000000000000000000
I20260923 14:41:08.176784 23558 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 14:41:08.177914 24110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 14:41:08.179827 24110 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: tablet copy: Starting download of 0 data blocks...
I20260923 14:41:08.179979 24110 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: tablet copy: Starting download of 1 WAL segments...
I20260923 14:41:08.181278 24110 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 14:41:08.182775 23558 tablet_copy_service.cc:342] P 108d5270212a410c9d51bfb74d86c98f: Request end of tablet copy session 2084552ab4e540cfa29b64a77316f860-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.4.188@KRBTEST.COM'} at 127.0.0.1:35612
I20260923 14:41:08.182845 23558 tablet_copy_service.cc:433] P 108d5270212a410c9d51bfb74d86c98f: ending tablet copy session 2084552ab4e540cfa29b64a77316f860-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2084552ab4e540cfa29b64a77316f860
I20260923 14:41:08.189998 24110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:08.191527 24298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.191601 24295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.191846 24296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:08.192384 24110 server_base.cc:1034] running on GCE node
I20260923 14:41:08.192525 24110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:08.192796 24110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:08.193949 24110 hybrid_clock.cc:648] HybridClock initialized: now 1790174468193926 us; error 39 us; skew 500 ppm
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:08.195560 24110 init.cc:377] Logged in from keytab as oryx/127.17.4.188@KRBTEST.COM (short username oryx)
I20260923 14:41:08.196056 24110 webserver.cc:460] Webserver started at http://127.17.4.188:46215/ using document root <none> and password file <none>
I20260923 14:41:08.196218 24110 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:08.196254 24110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:08.197482 24110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:08.198467 24305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.198758 24110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:08.198823 24110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
uuid: "2084552ab4e540cfa29b64a77316f860"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "46b4bfcc0d8f6c89bf5948791482a8d4"
server_key_iv: "ea20a9f4e3f6b3ca4edf0abab516991f"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.198909 24110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:08.219870 24110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:08.221913 24110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:08.226747 24110 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.188:35327
I20260923 14:41:08.226851 24357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.188:35327 every 8 connection(s)
I20260923 14:41:08.227291 24110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
I20260923 14:41:08.228888 24358 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:41:08.229808 24358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Bootstrap starting.
I20260923 14:41:08.240198 24358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:41:08.240463 24358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: Bootstrap complete.
I20260923 14:41:08.241091 24358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } }
I20260923 14:41:08.241231 24358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2084552ab4e540cfa29b64a77316f860, State: Initialized, Role: LEARNER
I20260923 14:41:08.241338 24358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } }
I20260923 14:41:08.241622 24364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.241741 24358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:08.241802 24364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: This master's current role is: LEARNER
I20260923 14:41:08.244426 24375 catalog_manager.cc:1259] Loaded cluster ID: 4f47fb55797546218928f2bd443ab036
I20260923 14:41:08.244481 24375 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: loading cluster ID for follower catalog manager: success
W20260923 14:41:08.245224 24282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:08.245565 24282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:08.245637 24282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 14:41:08.246842 24375 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: acquiring CA information for follower catalog manager: success
I20260923 14:41:08.248118 24375 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 14:41:08.250303 24282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:08.250350 24282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:08.250448 24282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:08.255378 24282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:32871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=46795
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:08.256402 24282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:08.257398 24282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:08.267211 24282 server_base.cc:1034] running on GCE node
W20260923 14:41:08.267186 24378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.267294 24377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.267181 24380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:08.267879 24282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:08.268469 24282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:08.269621 24282 hybrid_clock.cc:648] HybridClock initialized: now 1790174468269588 us; error 44 us; skew 500 ppm
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:08.272164 24282 init.cc:377] Logged in from keytab as oryx/127.17.4.129@KRBTEST.COM (short username oryx)
I20260923 14:41:08.272948 24282 webserver.cc:460] Webserver started at http://127.17.4.129:46795/ using document root <none> and password file <none>
I20260923 14:41:08.273428 24282 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:08.273494 24282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:08.277185 24282 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:08.279107 24387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.280287 24282 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:08.280401 24282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "d8d6c191d99f44bba8dadea90a9034a5"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "82991182269d757e74cd771bcd3578ef"
server_key_iv: "dc24641a6ac1750de366d13bace1252a"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.280931 24282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:08.295396 24282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:08.298753 24282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:08.298946 24282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:08.299487 24282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:08.300344 24282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:08.300420 24282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.300485 24282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:08.300541 24282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.309433 23863 heartbeater.cc:503] Master 127.17.4.190:44463 was elected leader, sending a full tablet report...
I20260923 14:41:08.309510 24282 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:32871
I20260923 14:41:08.309567 24500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:32871 every 8 connection(s)
I20260923 14:41:08.310745 24282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:08.317839 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 24282
I20260923 14:41:08.318027 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23734
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.188@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:08.324285 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:44717
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:44463
--webserver_port=36311
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:41:08.328476 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.312445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:54701 (local address 127.17.4.190:44463)
0923 14:41:08.312571 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.312579 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.313733 (+ 1154us) server_negotiation.cc:407] Connection header received
0923 14:41:08.314819 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.314822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.314869 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.314924 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.316397 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.317207 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.320576 (+ 3369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.320931 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.321004 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.323958 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.323962 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.323964 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.323989 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.325841 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326609 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.326624 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.326627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.326715 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.327112 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.327115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.327117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.327347 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.327427 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.328135 (+ 708us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.328269 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 14:41:08.328425 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.314349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:43275 (local address 127.17.4.189:36151)
0923 14:41:08.314516 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.314522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.314667 (+ 145us) server_negotiation.cc:407] Connection header received
0923 14:41:08.314781 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.314787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.314844 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.314927 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.316383 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.316905 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.319739 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.320080 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.320177 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.323538 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.323541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.323544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.323573 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.326088 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326701 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.326704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.326706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.326809 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.327112 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.327115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.327116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.327324 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.327394 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.328141 (+ 747us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.328258 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 14:41:08.329507 24507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.313968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.17.4.129:49425)
0923 14:41:08.314335 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.314350 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.314592 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.315185 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.315188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.315623 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.316243 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.316257 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.317560 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.317563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.319382 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.319391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.320097 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.320102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.320295 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.320993 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.321018 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.323819 (+ 2801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.326147 (+ 2328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326153 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.326158 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.326589 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.326902 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326905 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.326907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.327017 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.327459 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.327465 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.327855 (+ 390us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.328066 (+ 211us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.328376 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":117,"spinlock_wait_cycles":28544,"thread_start_us":91,"threads_started":1}
I20260923 14:41:08.329945 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.314034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.17.4.129:43275)
0923 14:41:08.314573 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.314586 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.314669 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.315089 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.315101 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.315594 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.316241 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.316254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.317042 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.317045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.319620 (+ 2575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.319631 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.320290 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.320293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.320413 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.321115 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.321129 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.323348 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.326201 (+ 2853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326206 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.326210 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.326589 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.326902 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326905 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.326907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.327010 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.327459 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.327465 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.327855 (+ 390us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.329642 (+ 1787us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.329788 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":261,"spinlock_wait_cycles":48640,"thread_start_us":70,"threads_started":1}
I20260923 14:41:08.330214 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.314084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:49425 (local address 127.17.4.188:35327)
0923 14:41:08.314963 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.314968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.314979 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:08.315019 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.315022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.315066 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.315163 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.316398 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.317418 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.319501 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.319844 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.319936 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.323980 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.323986 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.323990 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.324020 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.326019 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326701 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.326704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.326706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.326809 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.327112 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.327115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.327116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.327324 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.327407 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.329904 (+ 2497us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.330037 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":91,"threads_started":1}
I20260923 14:41:08.330868 24505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.312786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:54701)
0923 14:41:08.313592 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.313631 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.314589 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.315088 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.315099 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.315628 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.316243 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.316257 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.317321 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.317324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.320453 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.320463 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.321149 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.321152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.321246 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.321672 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.321685 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.323808 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.325980 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.325988 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.326005 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.326491 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.326842 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.326846 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.326848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.327007 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.327487 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.327492 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.327856 (+ 364us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.328935 (+ 1079us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.329113 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":75,"spinlock_wait_cycles":15232,"thread_start_us":501,"threads_started":1}
I20260923 14:41:08.331130 24501 heartbeater.cc:347] Connected to a master server at 127.17.4.188:35327
I20260923 14:41:08.331384 24503 heartbeater.cc:347] Connected to a master server at 127.17.4.189:36151
I20260923 14:41:08.331683 24503 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.331683 24501 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.332335 24501 heartbeater.cc:511] Master 127.17.4.188:35327 requested a full tablet report, sending...
I20260923 14:41:08.332335 24503 heartbeater.cc:511] Master 127.17.4.189:36151 requested a full tablet report, sending...
I20260923 14:41:08.332906 24502 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44463
I20260923 14:41:08.332978 24502 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.333101 24502 heartbeater.cc:511] Master 127.17.4.190:44463 requested a full tablet report, sending...
I20260923 14:41:08.333981 24322 ts_manager.cc:194] Registered new tserver with Master: d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871)
I20260923 14:41:08.334017 24138 ts_manager.cc:194] Registered new tserver with Master: d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871)
I20260923 14:41:08.334748 23538 ts_manager.cc:194] Re-registered known tserver with Master: d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871)
I20260923 14:41:08.335441 23538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:54701
W20260923 14:41:08.434203 24509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:08.434491 24509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:08.434562 24509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:08.438462 24509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:08.438539 24509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:08.438623 24509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:08.443739 24509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:44717
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=36311
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:08.444667 24509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:08.445536 24509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:08.454432 24517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.454386 24515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.454425 24514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:08.454767 24509 server_base.cc:1034] running on GCE node
I20260923 14:41:08.455196 24509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:08.455812 24509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:08.456980 24509 hybrid_clock.cc:648] HybridClock initialized: now 1790174468456964 us; error 37 us; skew 500 ppm
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:08.459813 24509 init.cc:377] Logged in from keytab as oryx/127.17.4.130@KRBTEST.COM (short username oryx)
I20260923 14:41:08.460676 24509 webserver.cc:460] Webserver started at http://127.17.4.130:36311/ using document root <none> and password file <none>
I20260923 14:41:08.461205 24509 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:08.461297 24509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:08.464757 24509 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260923 14:41:08.466643 24524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.467748 24509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:08.467953 24509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "16734ba172984ae68335d86eab1b3f22"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "11c5b089128244a15a65a6f0b2ed0478"
server_key_iv: "785dd4f0db037802fd411f45c3d43058"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.468454 24509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:08.480134 24509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:08.482617 24509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:08.482798 24509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:08.483304 24509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:08.484212 24509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:08.484277 24509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.484336 24509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:08.484386 24509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.492745 24509 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:44717
I20260923 14:41:08.492775 24637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:44717 every 8 connection(s)
I20260923 14:41:08.493659 24509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:08.500984 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 24509
I20260923 14:41:08.501181 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23868
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.188@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:08.509234 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.495380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:52931 (local address 127.17.4.188:35327)
0923 14:41:08.495550 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.495555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.496612 (+ 1057us) server_negotiation.cc:407] Connection header received
0923 14:41:08.497502 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.497505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.497588 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.497668 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.499008 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.499746 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.501445 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.501815 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.501888 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.505198 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.505202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.505204 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.505231 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.506883 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.507471 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.507476 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.507478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.507565 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.507976 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.507979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.507981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.508201 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.508273 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.508886 (+ 613us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.509027 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:41:08.509469 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:40079
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:44463
--webserver_port=39141
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:41:08.509884 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.496855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:58595 (local address 127.17.4.189:36151)
0923 14:41:08.496975 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.496980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.497089 (+ 109us) server_negotiation.cc:407] Connection header received
0923 14:41:08.497513 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.497516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.497588 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.497651 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.499017 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.499815 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.501997 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.502304 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.502381 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.505506 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.505510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.505513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.505558 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.507356 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.507908 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.507914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.507919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.507999 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.508288 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.508294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.508299 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.508767 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.508837 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.509621 (+ 784us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.509762 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:41:08.510653 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.495700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.17.4.130:52931)
0923 14:41:08.496518 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.496531 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.497279 (+ 748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.497843 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.497851 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.498243 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.498867 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.498880 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.499933 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.499936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.501320 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.501333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.502067 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.502071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.502251 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.502799 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.502818 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.505014 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.507008 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.507013 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.507026 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.507355 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.507681 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.507686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.507691 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.507875 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.508348 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.508353 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.508627 (+ 274us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.509386 (+ 759us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.509732 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"mutex_wait_us":231,"spinlock_wait_cycles":19072,"thread_start_us":133,"threads_started":1}
I20260923 14:41:08.510959 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.496725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.17.4.130:58595)
0923 14:41:08.497002 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.497015 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.497276 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.497845 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.497852 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.498319 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.498881 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.498888 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.499933 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.499936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.501881 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.501889 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.502532 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.502535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.502606 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.503051 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.503063 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.505353 (+ 2290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.507497 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.507500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.507502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.507801 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.508108 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.508110 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.508112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.508186 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.509262 (+ 1076us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.509267 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.509424 (+ 157us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.510049 (+ 625us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.510161 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":323,"spinlock_wait_cycles":32640,"thread_start_us":85,"threads_started":1}
I20260923 14:41:08.511981 24640 heartbeater.cc:347] Connected to a master server at 127.17.4.189:36151
I20260923 14:41:08.512009 24638 heartbeater.cc:347] Connected to a master server at 127.17.4.188:35327
I20260923 14:41:08.512207 24638 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.512207 24640 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.512766 24640 heartbeater.cc:511] Master 127.17.4.189:36151 requested a full tablet report, sending...
I20260923 14:41:08.512766 24638 heartbeater.cc:511] Master 127.17.4.188:35327 requested a full tablet report, sending...
I20260923 14:41:08.513777 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.495285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:48897 (local address 127.17.4.190:44463)
0923 14:41:08.495422 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.495427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.496371 (+ 944us) server_negotiation.cc:407] Connection header received
0923 14:41:08.497513 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.497517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.497597 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.497651 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.499018 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.499815 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.504536 (+ 4721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.504884 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.504998 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.508104 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.508110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.508115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.508147 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.511869 (+ 3722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.512368 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.512374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.512375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.512462 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.512775 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.512780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.512784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.512998 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.513086 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.513430 (+ 344us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.513556 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 14:41:08.513797 24322 ts_manager.cc:194] Registered new tserver with Master: 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717)
I20260923 14:41:08.513798 24138 ts_manager.cc:194] Registered new tserver with Master: 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717)
I20260923 14:41:08.514334 24642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.495700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:48897)
0923 14:41:08.496208 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.496254 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.497276 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.497845 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.497852 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.498315 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.498880 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.498888 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.499951 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.499954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.504393 (+ 4439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.504407 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.505035 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.505042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.505184 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.506280 (+ 1096us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.506305 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.507942 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.511997 (+ 4055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.512002 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.512003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.512256 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.512565 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.512567 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.512569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.512682 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.513143 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.513148 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.513242 (+ 94us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.513912 (+ 670us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.514062 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":288,"spinlock_wait_cycles":3840,"thread_start_us":566,"threads_started":1}
I20260923 14:41:08.514909 24639 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44463
I20260923 14:41:08.515007 24639 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.515163 24639 heartbeater.cc:511] Master 127.17.4.190:44463 requested a full tablet report, sending...
I20260923 14:41:08.515889 23538 ts_manager.cc:194] Re-registered known tserver with Master: 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717)
I20260923 14:41:08.516450 23538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:48897
I20260923 14:41:08.568193 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.565107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59456 (local address 127.17.4.188:35327)
0923 14:41:08.565237 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.565242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.565255 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:08.565392 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.565395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.565453 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.565545 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.565803 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.566268 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.567228 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.567650 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.567770 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.567931 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.568003 (+ 72us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.568067 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:41:08.568193 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.565031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.0.0.1:59456)
0923 14:41:08.565147 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.565163 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.565265 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.565567 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.565570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.565588 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.565697 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.565702 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.566366 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.566372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.567089 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.567096 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.567799 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.567803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.567888 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.567908 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.567981 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.568060 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260923 14:41:08.568800 24332 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260923 14:41:08.569155 24364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 108d5270212a410c9d51bfb74d86c98f. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.569306 24364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: This master's current role is: LEARNER
W20260923 14:41:08.617857 24645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:08.618077 24645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:08.618117 24645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:08.621913 24645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:08.621958 24645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:08.622010 24645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:08.626863 24645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:40079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=39141
--tserver_master_addrs=127.17.4.190:44463,127.17.4.189:36151,127.17.4.188:35327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:08.627800 24645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:08.628715 24645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:08.637662 24651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:08.637722 24645 server_base.cc:1034] running on GCE node
W20260923 14:41:08.638049 24653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:08.638173 24650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:08.638525 24645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:08.639096 24645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:08.640256 24645 hybrid_clock.cc:648] HybridClock initialized: now 1790174468640234 us; error 34 us; skew 500 ppm
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:08.643234 24645 init.cc:377] Logged in from keytab as oryx/127.17.4.131@KRBTEST.COM (short username oryx)
I20260923 14:41:08.644104 24645 webserver.cc:460] Webserver started at http://127.17.4.131:39141/ using document root <none> and password file <none>
I20260923 14:41:08.644595 24645 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:08.644661 24645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:08.648273 24645 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260923 14:41:08.650138 24660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.651396 24645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:08.651482 24645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "786dedf7a34e45118f0ff8c612ce4dea"
format_stamp: "Formatted at 2026-09-23 14:41:07 on dist-test-slave-54kg"
server_key: "1d3a98756eb5f40a25caa972eb3bd116"
server_key_iv: "362ad59a849f3ef8e9ba4e1e6ef339af"
server_key_version: "encryptionkey@0"
I20260923 14:41:08.652046 24645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:08.684231 24645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:08.687084 24645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:08.687242 24645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:08.687955 24645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:08.688855 24645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:08.688910 24645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.688951 24645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:08.688971 24645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:08.697395 24645 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:40079
I20260923 14:41:08.697424 24773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:40079 every 8 connection(s)
I20260923 14:41:08.698362 24645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:08.706748 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 24645
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.188@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
Sep 23 14:41:08 dist-test-slave-54kg krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174468, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.189@KRBTEST.COM
I20260923 14:41:08.715358 24780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.701461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.17.4.131:50179)
0923 14:41:08.701810 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.701821 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.702092 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.702582 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.702584 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.703130 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.703614 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.703621 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.704720 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.704723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.705766 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.705772 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.706323 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.706330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.706557 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.707603 (+ 1046us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.707628 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.709876 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.712251 (+ 2375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.712256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.712269 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.712621 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.712913 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.712916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.712918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.713082 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.713542 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.713547 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.713825 (+ 278us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.714013 (+ 188us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.714327 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":262,"spinlock_wait_cycles":8192,"thread_start_us":150,"threads_started":1}
I20260923 14:41:08.716004 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.700108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:49609 (local address 127.17.4.190:44463)
0923 14:41:08.700227 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.700232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.701109 (+ 877us) server_negotiation.cc:407] Connection header received
0923 14:41:08.702349 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.702352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.702405 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.702450 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.703778 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.704583 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.705923 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.706165 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.706220 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.710199 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.710202 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.710204 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.710229 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.712797 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.713524 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.713528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.713530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.713620 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.713921 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.713925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.713926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.714116 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.714486 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.715742 (+ 1256us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.715863 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:41:08.716048 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.701628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:50179 (local address 127.17.4.189:36151)
0923 14:41:08.701762 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.701767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.701925 (+ 158us) server_negotiation.cc:407] Connection header received
0923 14:41:08.702312 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.702316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.702366 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.702413 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.703778 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.704574 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.705907 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.706177 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.706258 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.710221 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.710224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.710227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.710248 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.712130 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.712732 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.712736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.712737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.712816 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.713181 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.713184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.713186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.713392 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.713486 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.715737 (+ 2251us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.715880 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:41:08.715636 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.700522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:49609)
0923 14:41:08.700951 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.700999 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.702092 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.702582 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.702584 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.703135 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.703609 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.703617 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.704720 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.704723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.705763 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.705772 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.706383 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.706388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.706572 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.707287 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.707304 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.710093 (+ 2789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.712921 (+ 2828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.712924 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.712928 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.713419 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.713710 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.713714 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.713715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.713801 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.714522 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.714526 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.714636 (+ 110us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.714735 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.714853 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":274,"spinlock_wait_cycles":39296,"thread_start_us":134,"threads_started":1}
I20260923 14:41:08.717358 24778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.700522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.17.4.131:43947)
0923 14:41:08.700951 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.700999 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.702091 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.702577 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.702582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.703130 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:08.703603 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.703615 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.704526 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.704530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.705397 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.705406 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.706350 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.706353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.706527 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.707123 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:08.707146 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:08.709990 (+ 2844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:08.713012 (+ 3022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.713018 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.713021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.713284 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.716353 (+ 3069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:08.716356 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:08.716358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:08.716443 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:08.716885 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:08.716889 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:08.716970 (+ 81us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.717050 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.717166 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":16,"spinlock_wait_cycles":67456,"thread_start_us":106,"threads_started":1}
I20260923 14:41:08.717684 24776 heartbeater.cc:347] Connected to a master server at 127.17.4.189:36151
I20260923 14:41:08.717883 24776 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.717888 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.700100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:43947 (local address 127.17.4.188:35327)
0923 14:41:08.700241 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.700245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.701102 (+ 857us) server_negotiation.cc:407] Connection header received
0923 14:41:08.702292 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.702296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.702355 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.702424 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.703741 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.704364 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.705521 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.705852 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.705939 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.710103 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.710107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.710110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.710135 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.712911 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.716163 (+ 3252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.716168 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.716172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.716251 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.716548 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.716553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.716555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.716777 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.717536 (+ 759us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.717637 (+ 101us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.717756 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 14:41:08.718209 24775 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44463
I20260923 14:41:08.718293 24775 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.718393 24776 heartbeater.cc:511] Master 127.17.4.189:36151 requested a full tablet report, sending...
I20260923 14:41:08.718511 24775 heartbeater.cc:511] Master 127.17.4.190:44463 requested a full tablet report, sending...
I20260923 14:41:08.718305 24774 heartbeater.cc:347] Connected to a master server at 127.17.4.188:35327
I20260923 14:41:08.718950 24774 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:08.719126 24774 heartbeater.cc:511] Master 127.17.4.188:35327 requested a full tablet report, sending...
I20260923 14:41:08.719473 23538 ts_manager.cc:194] Re-registered known tserver with Master: 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079)
I20260923 14:41:08.719484 24138 ts_manager.cc:194] Registered new tserver with Master: 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079)
I20260923 14:41:08.719926 24322 ts_manager.cc:194] Registered new tserver with Master: 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079)
I20260923 14:41:08.720230 23538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:49609
I20260923 14:41:08.722513 24787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.709110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39140 (local address 127.17.4.189:36151)
0923 14:41:08.709318 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.709322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.709696 (+ 374us) server_negotiation.cc:407] Connection header received
0923 14:41:08.709784 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.709787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.709828 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.709916 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.713686 (+ 3770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.714479 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.715612 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.715928 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.715994 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.719301 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.719304 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.719306 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.719324 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.720862 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.721303 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.721306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.721308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.721389 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.721685 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.721688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.721690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.721875 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.722007 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.722224 (+ 217us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.722337 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260923 14:41:08.723604 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.708740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35622 (local address 127.17.4.190:44463)
0923 14:41:08.710206 (+ 1466us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.710210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.710221 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:08.710256 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.710275 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.710323 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.710409 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.711396 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.712256 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.713426 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.713734 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.714225 (+ 491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.715407 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.715414 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.715419 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.715446 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.717357 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.722004 (+ 4647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.722006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.722008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.722103 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.722452 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.722455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.722456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.722659 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.723261 (+ 602us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.723346 (+ 85us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.723466 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1386,"thread_start_us":99,"threads_started":1}
I20260923 14:41:08.727316 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.710851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59466 (local address 127.17.4.188:35327)
0923 14:41:08.718387 (+ 7536us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.718391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.718406 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:41:08.719698 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.719701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.719738 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.719800 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.720809 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.721470 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.722472 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.722801 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.722920 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.724281 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.724284 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.724286 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.724306 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.725808 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.726222 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.726227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.726228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.726310 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.726577 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.726582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.726583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.726744 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.726870 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.727079 (+ 209us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.727172 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7481,"thread_start_us":90,"threads_started":1}
I20260923 14:41:08.726256 23538 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:08.729363 23538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:08.731626 24286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: NON_VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: true } } }
I20260923 14:41:08.731792 24286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.734472 24794 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: attempting to promote NON_VOTER 2084552ab4e540cfa29b64a77316f860 to VOTER
I20260923 14:41:08.734787 24794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } }
I20260923 14:41:08.736033 24332 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 LEARNER]: Refusing update from remote peer 108d5270212a410c9d51bfb74d86c98f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260923 14:41:08.736123 24148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Refusing update from remote peer 108d5270212a410c9d51bfb74d86c98f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260923 14:41:08.736403 24794 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260923 14:41:08.736523 24793 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260923 14:41:08.738094 24793 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2084552ab4e540cfa29b64a77316f860 (127.17.4.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.738514 24148 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2084552ab4e540cfa29b64a77316f860 (127.17.4.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.739578 24793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.739711 24793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.739878 24793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.739971 24793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.740187 24801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.740348 24801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:08.740563 24793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.740685 24793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:08.741765 24332 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2084552ab4e540cfa29b64a77316f860 (127.17.4.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.743391 24364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "108d5270212a410c9d51bfb74d86c98f" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:08.743494 24364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:08.751822 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.746796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:32871 (local address 127.0.0.1:39400)
0923 14:41:08.746929 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.746944 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.747017 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.747817 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.747819 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.747852 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.747947 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.747956 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.749561 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.749566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.750422 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.750431 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.751444 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.751449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.751523 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.751544 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.751597 (+ 53us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.751671 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":81,"spinlock_wait_cycles":10368}
I20260923 14:41:08.752310 24805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.747361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:44717 (local address 127.0.0.1:44780)
0923 14:41:08.747732 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.747745 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.747860 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.748449 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.748451 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.748465 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.748545 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.748551 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.749962 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.749965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.750944 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.750954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.751991 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.751994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.752079 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.752125 (+ 46us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.752166 (+ 41us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.752222 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":48,"spinlock_wait_cycles":2304,"thread_start_us":75,"threads_started":1}
I20260923 14:41:08.752560 24803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.746981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39400 (local address 127.17.4.129:32871)
0923 14:41:08.747298 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.747308 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.747330 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:41:08.747406 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.747412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.747631 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.748327 (+ 696us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.748458 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.749456 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.750547 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.751313 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.752061 (+ 748us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.752230 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.752278 (+ 48us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.752411 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":123,"threads_started":1}
I20260923 14:41:08.753001 24806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.747515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44780 (local address 127.17.4.130:44717)
0923 14:41:08.747979 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.747992 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.748017 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:41:08.748100 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.748105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.748302 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.748688 (+ 386us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.748829 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.749844 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.751092 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.751842 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.752569 (+ 727us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.752714 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.752772 (+ 58us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.752854 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":106,"threads_started":1}
I20260923 14:41:08.753320 24804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.747361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:40079 (local address 127.0.0.1:36688)
0923 14:41:08.748222 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.748236 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.748319 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.748894 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.748897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.748911 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.749006 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.749011 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.750161 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.750164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.751340 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.751352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.752784 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.752788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.752862 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.752881 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.752955 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.753041 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":178,"thread_start_us":93,"threads_started":1}
I20260923 14:41:08.753780 24807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.747858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36688 (local address 127.17.4.131:40079)
0923 14:41:08.748137 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.748147 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.748403 (+ 256us) server_negotiation.cc:407] Connection header received
0923 14:41:08.748472 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.748476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.748631 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.748761 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.749129 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.750059 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.751464 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.752300 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.752454 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.752580 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.752994 (+ 414us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.753092 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":115,"threads_started":1}
I20260923 14:41:08.755395 24435 tablet_service.cc:1467] Processing CreateTablet for tablet 360cdc48bc5a456fb5962eed1be94778 (DEFAULT_TABLE table=test-table [id=d3878309a3764e3e91796aebd11b3c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:08.755371 24572 tablet_service.cc:1467] Processing CreateTablet for tablet 360cdc48bc5a456fb5962eed1be94778 (DEFAULT_TABLE table=test-table [id=d3878309a3764e3e91796aebd11b3c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:08.756340 24572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360cdc48bc5a456fb5962eed1be94778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:08.756371 24435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360cdc48bc5a456fb5962eed1be94778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:08.762461 24808 tablet_bootstrap.cc:492] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Bootstrap starting.
I20260923 14:41:08.763242 24809 tablet_bootstrap.cc:492] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Bootstrap starting.
I20260923 14:41:08.764840 24808 tablet_bootstrap.cc:654] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:08.765067 24809 tablet_bootstrap.cc:654] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:08.764663 24708 tablet_service.cc:1467] Processing CreateTablet for tablet 360cdc48bc5a456fb5962eed1be94778 (DEFAULT_TABLE table=test-table [id=d3878309a3764e3e91796aebd11b3c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:08.765673 24708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360cdc48bc5a456fb5962eed1be94778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:08.765668 24808 log.cc:824] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:08.765748 24809 log.cc:824] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:08.767537 24808 tablet_bootstrap.cc:492] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: No bootstrap required, opened a new log
I20260923 14:41:08.767717 24808 ts_tablet_manager.cc:1397] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:41:08.769006 24809 tablet_bootstrap.cc:492] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: No bootstrap required, opened a new log
I20260923 14:41:08.769197 24809 ts_tablet_manager.cc:1397] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260923 14:41:08.771996 24808 raft_consensus.cc:348] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.772281 24808 raft_consensus.cc:374] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:08.772328 24808 raft_consensus.cc:729] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8d6c191d99f44bba8dadea90a9034a5, State: Initialized, Role: FOLLOWER
I20260923 14:41:08.772591 24809 raft_consensus.cc:348] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.772825 24809 raft_consensus.cc:374] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:08.772735 24808 consensus_queue.cc:260] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.772876 24809 raft_consensus.cc:729] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16734ba172984ae68335d86eab1b3f22, State: Initialized, Role: FOLLOWER
I20260923 14:41:08.773269 24809 consensus_queue.cc:260] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.773705 24808 ts_tablet_manager.cc:1428] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260923 14:41:08.773933 24812 tablet_bootstrap.cc:492] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Bootstrap starting.
I20260923 14:41:08.774171 24809 ts_tablet_manager.cc:1428] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:41:08.774930 24502 heartbeater.cc:503] Master 127.17.4.190:44463 was elected leader, sending a full tablet report...
I20260923 14:41:08.775135 24639 heartbeater.cc:503] Master 127.17.4.190:44463 was elected leader, sending a full tablet report...
I20260923 14:41:08.780594 24812 tablet_bootstrap.cc:654] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:08.781384 24812 log.cc:824] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:08.783377 24812 tablet_bootstrap.cc:492] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: No bootstrap required, opened a new log
I20260923 14:41:08.783560 24812 ts_tablet_manager.cc:1397] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260923 14:41:08.788193 24812 raft_consensus.cc:348] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.788458 24812 raft_consensus.cc:374] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:08.788496 24812 raft_consensus.cc:729] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786dedf7a34e45118f0ff8c612ce4dea, State: Initialized, Role: FOLLOWER
I20260923 14:41:08.788921 24812 consensus_queue.cc:260] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.789556 24775 heartbeater.cc:503] Master 127.17.4.190:44463 was elected leader, sending a full tablet report...
I20260923 14:41:08.789835 24812 ts_tablet_manager.cc:1428] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260923 14:41:08.812496 24504 tablet.cc:2369] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:08.823891 24816 raft_consensus.cc:482] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:08.824075 24816 raft_consensus.cc:504] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.825240 24816 leader_election.cc:288] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871), 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717)
I20260923 14:41:08.829881 24806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.825644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:54723 (local address 127.17.4.130:44717)
0923 14:41:08.825760 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.825764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.825776 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:08.825818 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.825821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.825861 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.825934 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.826274 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.827029 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.828657 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.829228 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.829342 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.829390 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.829701 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.829765 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:41:08.829901 24803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.825545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:37053 (local address 127.17.4.129:32871)
0923 14:41:08.825703 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.825708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.825723 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:41:08.825801 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.825804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.825854 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.825934 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:08.826274 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.827029 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.828663 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.829227 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.829342 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.829390 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.829701 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.829765 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:41:08.829896 24778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.825458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:44717 (local address 127.17.4.131:54723)
0923 14:41:08.825641 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.825654 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.825710 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.825961 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.825964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.825986 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.826164 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.826169 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.827139 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.827142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.828537 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.828546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.829345 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.829349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.829539 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.829599 (+ 60us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.829669 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.829751 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":275,"spinlock_wait_cycles":8832}
I20260923 14:41:08.829896 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.825433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:32871 (local address 127.17.4.131:37053)
0923 14:41:08.825590 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:08.825605 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:08.825710 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:08.825961 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:08.825964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:08.825986 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:08.826156 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.826164 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.827139 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.827142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.828535 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:08.828546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.829345 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.829349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:08.829515 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.829590 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 14:41:08.829668 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 14:41:08.829751 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":189,"spinlock_wait_cycles":5504}
I20260923 14:41:08.830575 24592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360cdc48bc5a456fb5962eed1be94778" candidate_uuid: "786dedf7a34e45118f0ff8c612ce4dea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16734ba172984ae68335d86eab1b3f22" is_pre_election: true
I20260923 14:41:08.830755 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360cdc48bc5a456fb5962eed1be94778" candidate_uuid: "786dedf7a34e45118f0ff8c612ce4dea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8d6c191d99f44bba8dadea90a9034a5" is_pre_election: true
I20260923 14:41:08.830865 24592 raft_consensus.cc:2454] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786dedf7a34e45118f0ff8c612ce4dea in term 0.
I20260923 14:41:08.831018 24455 raft_consensus.cc:2454] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 786dedf7a34e45118f0ff8c612ce4dea in term 0.
I20260923 14:41:08.831307 24661 leader_election.cc:302] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16734ba172984ae68335d86eab1b3f22, 786dedf7a34e45118f0ff8c612ce4dea; no voters:
I20260923 14:41:08.831550 24816 raft_consensus.cc:2781] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:08.831620 24816 raft_consensus.cc:482] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:08.831676 24816 raft_consensus.cc:3037] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:08.832656 24816 raft_consensus.cc:504] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.832966 24816 leader_election.cc:288] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [CANDIDATE]: Term 1 election: Requested vote from peers d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871), 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717)
I20260923 14:41:08.833320 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360cdc48bc5a456fb5962eed1be94778" candidate_uuid: "786dedf7a34e45118f0ff8c612ce4dea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8d6c191d99f44bba8dadea90a9034a5"
I20260923 14:41:08.833324 24592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360cdc48bc5a456fb5962eed1be94778" candidate_uuid: "786dedf7a34e45118f0ff8c612ce4dea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16734ba172984ae68335d86eab1b3f22"
I20260923 14:41:08.833439 24455 raft_consensus.cc:3037] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:08.833439 24592 raft_consensus.cc:3037] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:08.834678 24592 raft_consensus.cc:2454] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786dedf7a34e45118f0ff8c612ce4dea in term 1.
I20260923 14:41:08.834678 24455 raft_consensus.cc:2454] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 786dedf7a34e45118f0ff8c612ce4dea in term 1.
I20260923 14:41:08.834947 24663 leader_election.cc:302] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 786dedf7a34e45118f0ff8c612ce4dea, d8d6c191d99f44bba8dadea90a9034a5; no voters:
I20260923 14:41:08.835158 24816 raft_consensus.cc:2781] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:08.835390 24816 raft_consensus.cc:686] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 1 LEADER]: Becoming Leader. State: Replica: 786dedf7a34e45118f0ff8c612ce4dea, State: Running, Role: LEADER
I20260923 14:41:08.835763 24816 consensus_queue.cc:237] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } }
I20260923 14:41:08.839072 23537 catalog_manager.cc:5495] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea reported cstate change: term changed from 0 to 1, leader changed from <none> to 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131). New cstate: current_term: 1 leader_uuid: "786dedf7a34e45118f0ff8c612ce4dea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } health_report { overall_health: HEALTHY } } }
I20260923 14:41:08.850546 24807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.847447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36694 (local address 127.17.4.131:40079)
0923 14:41:08.847586 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.847589 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.847601 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:08.847736 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.847739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.847842 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.847922 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:08.848124 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.848624 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.849370 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.849560 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.849628 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.849846 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:08.850190 (+ 344us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:08.850271 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.850320 (+ 49us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.850361 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 14:41:08.855659 24455 raft_consensus.cc:1261] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Refusing update from remote peer 786dedf7a34e45118f0ff8c612ce4dea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:08.855685 24592 raft_consensus.cc:1261] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Refusing update from remote peer 786dedf7a34e45118f0ff8c612ce4dea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:08.856335 24816 consensus_queue.cc:1035] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:08.856500 24817 consensus_queue.cc:1035] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:08.865543 24821 mvcc.cc:205] Tried to move back new op lower bound from 7332554624426446848 to 7332554624353927168. Current Snapshot: MvccSnapshot[applied={T|T < 7332554624426446848}]
I20260923 14:41:08.874217 23538 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:08.874359 23538 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:08.879081 23538 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 108d5270212a410c9d51bfb74d86c98f: Sending DeleteTablet for 3 replicas of tablet 360cdc48bc5a456fb5962eed1be94778
I20260923 14:41:08.879707 24572 tablet_service.cc:1514] Processing DeleteTablet for tablet 360cdc48bc5a456fb5962eed1be94778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:08 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:44780
I20260923 14:41:08.879894 24435 tablet_service.cc:1514] Processing DeleteTablet for tablet 360cdc48bc5a456fb5962eed1be94778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:08 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:39400
I20260923 14:41:08.879916 24708 tablet_service.cc:1514] Processing DeleteTablet for tablet 360cdc48bc5a456fb5962eed1be94778 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:08 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:36688
I20260923 14:41:08.880276 24830 tablet_replica.cc:330] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: stopping tablet replica
I20260923 14:41:08.880294 24832 tablet_replica.cc:330] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: stopping tablet replica
I20260923 14:41:08.880545 24832 raft_consensus.cc:2229] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:08.880546 24830 raft_consensus.cc:2229] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:08.880851 24832 raft_consensus.cc:2258] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:08.880868 24830 raft_consensus.cc:2258] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:08.881208 24831 tablet_replica.cc:330] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: stopping tablet replica
I20260923 14:41:08.882428 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 23506
I20260923 14:41:08.882455 24830 ts_tablet_manager.cc:1905] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:08.883313 24832 ts_tablet_manager.cc:1905] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:08.885012 24831 raft_consensus.cc:2229] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:08.885360 24831 raft_consensus.cc:2258] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:08.886094 24832 ts_tablet_manager.cc:1918] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:08.886193 24832 log.cc:1196] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/360cdc48bc5a456fb5962eed1be94778
I20260923 14:41:08.886516 24832 ts_tablet_manager.cc:1939] T 360cdc48bc5a456fb5962eed1be94778 P 786dedf7a34e45118f0ff8c612ce4dea: Deleting consensus metadata
I20260923 14:41:08.887607 24831 ts_tablet_manager.cc:1905] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:08.889539 24831 ts_tablet_manager.cc:1918] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:08.889645 24831 log.cc:1196] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/360cdc48bc5a456fb5962eed1be94778
I20260923 14:41:08.889954 24831 ts_tablet_manager.cc:1939] T 360cdc48bc5a456fb5962eed1be94778 P d8d6c191d99f44bba8dadea90a9034a5: Deleting consensus metadata
I20260923 14:41:08.891013 24830 ts_tablet_manager.cc:1918] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:08.891088 24830 log.cc:1196] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/360cdc48bc5a456fb5962eed1be94778
I20260923 14:41:08.891662 24830 ts_tablet_manager.cc:1939] T 360cdc48bc5a456fb5962eed1be94778 P 16734ba172984ae68335d86eab1b3f22: Deleting consensus metadata
W20260923 14:41:08.892503 24661 connection.cc:535] server connection from 127.0.0.1:36688 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 14:41:08.893502 24526 connection.cc:441] server connection from 127.0.0.1:44780 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44780 (request call id 1) could send its response
I20260923 14:41:08.902673 24787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.881535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39156 (local address 127.17.4.189:36151)
0923 14:41:08.881759 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.881763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.891784 (+ 10021us) server_negotiation.cc:407] Connection header received
0923 14:41:08.893835 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.893838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.893887 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.893936 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.894945 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.895749 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.897140 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.897494 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.897583 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.899361 (+ 1778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.899364 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.899367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.899387 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.900991 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.901452 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.901455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.901457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.901527 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.901789 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.901792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.901794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.901974 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.902081 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.902427 (+ 346us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.902534 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260923 14:41:08.910336 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.898591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39158 (local address 127.17.4.189:36151)
0923 14:41:08.898708 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.898711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.899974 (+ 1263us) server_negotiation.cc:407] Connection header received
0923 14:41:08.900110 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.900113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.900148 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.900189 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.902766 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.903553 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.904732 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.905083 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.905174 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.906749 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.906752 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.906755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.906776 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.908489 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.908988 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.908991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.908996 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.909074 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.909394 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.909400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.909402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.909630 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.909730 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.910077 (+ 347us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.910173 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:41:08.913070 24790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.899215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.17.4.188:35327)
0923 14:41:08.899325 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.899335 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.901450 (+ 2115us) server_negotiation.cc:407] Connection header received
0923 14:41:08.901607 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.901610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.901667 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.901721 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.904769 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.905562 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.906758 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.907099 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.907186 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.909276 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.909281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.909283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.909307 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.911268 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.911800 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.911806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.911810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.911898 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.912209 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.912212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.912213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.912417 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.912550 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.912793 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.912912 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:41:08.913582 24508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:08.881638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59480 (local address 127.17.4.188:35327)
0923 14:41:08.881840 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:08.881843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:08.904194 (+ 22351us) server_negotiation.cc:407] Connection header received
0923 14:41:08.904313 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:08.904316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:08.904359 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:08.904442 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:08.905171 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.906219 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.907688 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:08.908127 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:08.908225 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:08.910063 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:08.910066 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:08.910069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:08.910090 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:08.911971 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.912395 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.912399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.912400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.912472 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:08.912793 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:08.912796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:08.912799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:08.912968 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:08.913051 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:08.913393 (+ 342us) server_negotiation.cc:299] Negotiation successful
0923 14:41:08.913491 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260923 14:41:09.866991 24841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:09.866615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:35175)
0923 14:41:09.866835 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:09.866904 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":83,"threads_started":1}
W20260923 14:41:09.867247 24502 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44463 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:09.869479 24842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:09.869097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:49659)
0923 14:41:09.869301 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:09.869380 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
W20260923 14:41:09.869756 24775 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44463 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:09.871495 24843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:09.871111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:37489)
0923 14:41:09.871321 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:09.871387 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":55,"threads_started":1}
W20260923 14:41:09.871735 24639 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44463 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:10.378548 24844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 108d5270212a410c9d51bfb74d86c98f)
I20260923 14:41:10.378791 24844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } }
I20260923 14:41:10.379645 24845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 108d5270212a410c9d51bfb74d86c98f)
I20260923 14:41:10.379812 24844 leader_election.cc:288] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463), 2084552ab4e540cfa29b64a77316f860 (127.17.4.188:35327)
I20260923 14:41:10.380127 24845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } }
I20260923 14:41:10.380403 24847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.379922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36106)
0923 14:41:10.380227 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.380303 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":23,"thread_start_us":51,"threads_started":1}
W20260923 14:41:10.380627 24125 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:10.381114 24845 leader_election.cc:288] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463), 8751807ba13b419e809a868d7c68c8a2 (127.17.4.189:36151)
I20260923 14:41:10.381870 24847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.381639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36126)
0923 14:41:10.381751 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.381807 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260923 14:41:10.381917 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.381194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36110)
0923 14:41:10.381745 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.381820 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":69,"threads_started":1}
W20260923 14:41:10.382084 24125 leader_election.cc:334] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463): Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
W20260923 14:41:10.382077 24309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:10.382875 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.382697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36130)
0923 14:41:10.382780 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.382823 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260923 14:41:10.383065 24309 leader_election.cc:334] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463): Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:10.384174 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.379922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35327 (local address 127.0.0.1:59496)
0923 14:41:10.380178 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.380192 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.380281 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.380700 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.380703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.380721 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.380824 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.380830 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.381841 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.381844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.383015 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.383025 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.383878 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.383881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.383947 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.383966 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.384020 (+ 54us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.384085 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":50,"threads_started":1}
I20260923 14:41:10.384224 24848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.380149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59496 (local address 127.17.4.188:35327)
0923 14:41:10.380431 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.380438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.380452 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:41:10.380519 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.380525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.380570 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.380690 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.380959 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.381712 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.383149 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.383736 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.383875 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.383934 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.384045 (+ 111us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.384116 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":62,"threads_started":1}
I20260923 14:41:10.384766 24332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8751807ba13b419e809a868d7c68c8a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2084552ab4e540cfa29b64a77316f860" is_pre_election: true
I20260923 14:41:10.384963 24332 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8751807ba13b419e809a868d7c68c8a2 in term 1.
I20260923 14:41:10.385282 24123 leader_election.cc:302] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2084552ab4e540cfa29b64a77316f860, 8751807ba13b419e809a868d7c68c8a2; no voters: 108d5270212a410c9d51bfb74d86c98f
I20260923 14:41:10.385638 24844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 14:41:10.385700 24844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 108d5270212a410c9d51bfb74d86c98f)
I20260923 14:41:10.385740 24844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 1 FOLLOWER]: Advancing to term 2
I20260923 14:41:10.385846 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.381489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:36151 (local address 127.0.0.1:39170)
0923 14:41:10.381974 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.381988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.382065 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.382479 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.382482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.382500 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.382577 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.382582 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.383505 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.383508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.384654 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.384662 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.385458 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.385461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.385548 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.385576 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.385636 (+ 60us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.385684 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":64,"threads_started":1}
I20260923 14:41:10.385879 24852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.381733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.17.4.189:36151)
0923 14:41:10.382265 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.382275 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.382289 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:41:10.382324 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.382327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.382366 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.382451 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.382697 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.383378 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.384761 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.385337 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.385510 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.385559 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.385652 (+ 93us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.385723 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":82,"threads_started":1}
I20260923 14:41:10.386229 24148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2084552ab4e540cfa29b64a77316f860" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8751807ba13b419e809a868d7c68c8a2" is_pre_election: true
I20260923 14:41:10.386828 24844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } }
I20260923 14:41:10.387086 24148 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2084552ab4e540cfa29b64a77316f860 in current term 2: Already voted for candidate 8751807ba13b419e809a868d7c68c8a2 in this term.
I20260923 14:41:10.387179 24844 leader_election.cc:288] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [CANDIDATE]: Term 2 election: Requested vote from peers 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463), 2084552ab4e540cfa29b64a77316f860 (127.17.4.188:35327)
I20260923 14:41:10.387465 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.387263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36132)
0923 14:41:10.387360 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.387411 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260923 14:41:10.387526 24309 leader_election.cc:302] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2084552ab4e540cfa29b64a77316f860; no voters: 108d5270212a410c9d51bfb74d86c98f, 8751807ba13b419e809a868d7c68c8a2
I20260923 14:41:10.387717 24845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 1 FOLLOWER]: Advancing to term 2
I20260923 14:41:10.387920 24332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8751807ba13b419e809a868d7c68c8a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2084552ab4e540cfa29b64a77316f860"
I20260923 14:41:10.388100 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.387902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36136)
0923 14:41:10.387998 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.388047 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 14:41:10.388213 24125 leader_election.cc:334] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463): Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
I20260923 14:41:10.388736 24845 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:41:10.389727 24332 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8751807ba13b419e809a868d7c68c8a2 in term 2.
I20260923 14:41:10.390014 24123 leader_election.cc:302] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2084552ab4e540cfa29b64a77316f860, 8751807ba13b419e809a868d7c68c8a2; no voters: 108d5270212a410c9d51bfb74d86c98f
I20260923 14:41:10.390156 24844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 14:41:10.390317 24844 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [term 2 LEADER]: Becoming Leader. State: Replica: 8751807ba13b419e809a868d7c68c8a2, State: Running, Role: LEADER
I20260923 14:41:10.390535 24844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } }
I20260923 14:41:10.391417 24854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8751807ba13b419e809a868d7c68c8a2. Latest consensus state: current_term: 2 leader_uuid: "8751807ba13b419e809a868d7c68c8a2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:10.391513 24854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:10.391809 24856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:10.393764 24856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:10.394127 24856 catalog_manager.cc:1259] Loaded cluster ID: 4f47fb55797546218928f2bd443ab036
I20260923 14:41:10.394167 24856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:10.394611 24856 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:10.394942 24856 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Loaded TSK: 0
I20260923 14:41:10.395505 24856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:41:10.418358 24138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:10.421232 24138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:10.423734 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.423504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36166)
0923 14:41:10.423620 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.423671 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 14:41:10.423720 24332 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [term 2 FOLLOWER]: Refusing update from remote peer 8751807ba13b419e809a868d7c68c8a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260923 14:41:10.424211 24844 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260923 14:41:10.424393 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.424170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.0.0.1:36176)
0923 14:41:10.424274 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.424315 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 14:41:10.424502 24125 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 -> Peer 108d5270212a410c9d51bfb74d86c98f (127.17.4.190:44463): Couldn't send request to peer 108d5270212a410c9d51bfb74d86c98f. Status: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260923 14:41:10.425614 24845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8751807ba13b419e809a868d7c68c8a2. Latest consensus state: current_term: 2 leader_uuid: "8751807ba13b419e809a868d7c68c8a2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:10.425729 24845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:10.426647 24854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "8751807ba13b419e809a868d7c68c8a2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:10.426750 24854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:10.426955 24845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "8751807ba13b419e809a868d7c68c8a2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "108d5270212a410c9d51bfb74d86c98f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44463 } } peers { permanent_uuid: "8751807ba13b419e809a868d7c68c8a2" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 36151 } attrs { promote: false } } peers { permanent_uuid: "2084552ab4e540cfa29b64a77316f860" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35327 } attrs { promote: false } } }
I20260923 14:41:10.427073 24845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2084552ab4e540cfa29b64a77316f860 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:41:10.427183 24858 mvcc.cc:205] Tried to move back new op lower bound from 7332554630851727360 to 7332554630721544192. Current Snapshot: MvccSnapshot[applied={T|T < 7332554630851727360}]
I20260923 14:41:10.435848 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.431972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:40079 (local address 127.0.0.1:36700)
0923 14:41:10.432056 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.432068 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.432159 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.432582 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.432588 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.432610 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.432696 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.432702 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.433622 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.433625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.434686 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.434695 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.435435 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.435438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.435522 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.435556 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.435626 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.435698 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260923 14:41:10.436205 24863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.432085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.17.4.131:40079)
0923 14:41:10.432319 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.432323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.432338 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:41:10.432387 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.432392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.432442 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.432575 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.432815 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.433503 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.434801 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.435326 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.435438 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.435501 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.435979 (+ 478us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.436062 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":69,"threads_started":1}
I20260923 14:41:10.436436 24847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.432283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:32871 (local address 127.0.0.1:39402)
0923 14:41:10.432365 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.432378 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.432452 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.432954 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.432957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.432973 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.433063 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.433068 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.434175 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.434177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.435033 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.435042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.435898 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.435901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.435989 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.436206 (+ 217us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.436260 (+ 54us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.436326 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":183}
I20260923 14:41:10.436666 24708 tablet_service.cc:1467] Processing CreateTablet for tablet b749761d0f114174928f995d102c7dfd (DEFAULT_TABLE table=test-table [id=0ebcadbfeb834622a939516ba7278c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:10.436932 24708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b749761d0f114174928f995d102c7dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:10.437178 24864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.432509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39402 (local address 127.17.4.129:32871)
0923 14:41:10.432723 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.432729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.432744 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:41:10.432795 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.432798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.432841 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.433199 (+ 358us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.433309 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.434053 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.435162 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.435738 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.436863 (+ 1125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.436919 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.436951 (+ 32us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.437015 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":58,"threads_started":1}
I20260923 14:41:10.437616 24435 tablet_service.cc:1467] Processing CreateTablet for tablet b749761d0f114174928f995d102c7dfd (DEFAULT_TABLE table=test-table [id=0ebcadbfeb834622a939516ba7278c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:10.437878 24435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b749761d0f114174928f995d102c7dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:10.438306 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.432574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:44717 (local address 127.0.0.1:44796)
0923 14:41:10.434263 (+ 1689us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.434275 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.434351 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.434710 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.434715 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.434735 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.434827 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.434832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.435902 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.435905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.436999 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.437007 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.437855 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.437859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.437984 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.438007 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.438101 (+ 94us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.438180 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1629,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260923 14:41:10.438349 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.432927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44796 (local address 127.17.4.130:44717)
0923 14:41:10.433716 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.433719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.434423 (+ 704us) server_negotiation.cc:407] Connection header received
0923 14:41:10.434475 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.434478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.434518 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.434609 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.434940 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.435707 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.437125 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.437738 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.437838 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.437898 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.438132 (+ 234us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.438222 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":65,"threads_started":1}
I20260923 14:41:10.438845 24572 tablet_service.cc:1467] Processing CreateTablet for tablet b749761d0f114174928f995d102c7dfd (DEFAULT_TABLE table=test-table [id=0ebcadbfeb834622a939516ba7278c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:10.439100 24572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b749761d0f114174928f995d102c7dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:10.440037 24867 tablet_bootstrap.cc:492] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Bootstrap starting.
I20260923 14:41:10.440573 24868 tablet_bootstrap.cc:492] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: Bootstrap starting.
I20260923 14:41:10.440827 24867 tablet_bootstrap.cc:654] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:10.441336 24868 tablet_bootstrap.cc:654] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:10.441475 24870 tablet_bootstrap.cc:492] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Bootstrap starting.
I20260923 14:41:10.442112 24867 tablet_bootstrap.cc:492] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: No bootstrap required, opened a new log
I20260923 14:41:10.442224 24867 ts_tablet_manager.cc:1397] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:10.442359 24870 tablet_bootstrap.cc:654] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:10.442682 24867 raft_consensus.cc:348] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.442795 24867 raft_consensus.cc:374] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:10.442833 24867 raft_consensus.cc:729] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786dedf7a34e45118f0ff8c612ce4dea, State: Initialized, Role: FOLLOWER
I20260923 14:41:10.442924 24868 tablet_bootstrap.cc:492] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: No bootstrap required, opened a new log
I20260923 14:41:10.442952 24867 consensus_queue.cc:260] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.443003 24868 ts_tablet_manager.cc:1397] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:10.443270 24867 ts_tablet_manager.cc:1428] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:10.443480 24868 raft_consensus.cc:348] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.443583 24868 raft_consensus.cc:374] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:10.443615 24868 raft_consensus.cc:729] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8d6c191d99f44bba8dadea90a9034a5, State: Initialized, Role: FOLLOWER
I20260923 14:41:10.443786 24868 consensus_queue.cc:260] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.444110 24868 ts_tablet_manager.cc:1428] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:10.444149 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.443733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:33485)
0923 14:41:10.444012 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.444067 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":104,"threads_started":1}
I20260923 14:41:10.445233 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.444847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:33579)
0923 14:41:10.445088 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.445142 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":94,"threads_started":1}
I20260923 14:41:10.446677 24870 tablet_bootstrap.cc:492] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: No bootstrap required, opened a new log
I20260923 14:41:10.446735 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.445775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:58503)
0923 14:41:10.446627 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.446675 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293}
I20260923 14:41:10.446759 24870 ts_tablet_manager.cc:1397] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260923 14:41:10.446825 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.446580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:37373)
0923 14:41:10.446716 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.446766 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260923 14:41:10.447032 24776 heartbeater.cc:503] Master 127.17.4.189:36151 was elected leader, sending a full tablet report...
I20260923 14:41:10.447160 24870 raft_consensus.cc:348] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.447252 24870 raft_consensus.cc:374] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:10.447289 24870 raft_consensus.cc:729] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16734ba172984ae68335d86eab1b3f22, State: Initialized, Role: FOLLOWER
I20260923 14:41:10.447400 24870 consensus_queue.cc:260] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.447711 24870 ts_tablet_manager.cc:1428] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:10.448655 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.448295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:36859)
0923 14:41:10.448499 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.448552 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260923 14:41:10.449360 24640 heartbeater.cc:503] Master 127.17.4.189:36151 was elected leader, sending a full tablet report...
I20260923 14:41:10.449649 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.449126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:55991)
0923 14:41:10.449227 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.449274 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 14:41:10.450692 24777 tablet.cc:2369] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:41:10.496294 24641 tablet.cc:2369] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:10.499980 24877 raft_consensus.cc:482] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:10.500125 24877 raft_consensus.cc:504] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.501053 24877 leader_election.cc:288] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079), d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871)
I20260923 14:41:10.504887 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.501251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:32871 (local address 127.17.4.130:48343)
0923 14:41:10.501378 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.501393 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.501490 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.501775 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.501778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.501799 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.501938 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.501944 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.502799 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.502803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.503713 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.503723 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.504459 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.504463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.504601 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.504626 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.504700 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.504765 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":23}
I20260923 14:41:10.504946 24864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.501378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:48343 (local address 127.17.4.129:32871)
0923 14:41:10.501521 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.501526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.501543 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:41:10.501601 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.501607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.501661 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.501757 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.502088 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.502716 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.503868 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.504344 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.504433 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.504473 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.504735 (+ 262us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.504823 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:41:10.505079 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.501251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:40079 (local address 127.17.4.130:37685)
0923 14:41:10.501776 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.501787 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.501867 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.502088 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:10.502090 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:10.502114 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:10.502190 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.502194 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.503100 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.503104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.503961 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:10.503971 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.504644 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.504647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:10.504763 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.504785 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:41:10.504861 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 14:41:10.504924 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":196,"thread_start_us":163,"threads_started":1}
I20260923 14:41:10.505102 24863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.501389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:37685 (local address 127.17.4.131:40079)
0923 14:41:10.501528 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.501533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.501876 (+ 343us) server_negotiation.cc:407] Connection header received
0923 14:41:10.501935 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.501937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.502002 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.502078 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:10.502317 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.502952 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.504071 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.504483 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.504628 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.504684 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.504890 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.504974 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:41:10.505548 24728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b749761d0f114174928f995d102c7dfd" candidate_uuid: "16734ba172984ae68335d86eab1b3f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786dedf7a34e45118f0ff8c612ce4dea" is_pre_election: true
I20260923 14:41:10.505610 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b749761d0f114174928f995d102c7dfd" candidate_uuid: "16734ba172984ae68335d86eab1b3f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8d6c191d99f44bba8dadea90a9034a5" is_pre_election: true
I20260923 14:41:10.505741 24455 raft_consensus.cc:2454] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16734ba172984ae68335d86eab1b3f22 in term 0.
I20260923 14:41:10.505802 24728 raft_consensus.cc:2454] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16734ba172984ae68335d86eab1b3f22 in term 0.
I20260923 14:41:10.506112 24527 leader_election.cc:302] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16734ba172984ae68335d86eab1b3f22, d8d6c191d99f44bba8dadea90a9034a5; no voters:
I20260923 14:41:10.506353 24877 raft_consensus.cc:2781] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:10.506412 24877 raft_consensus.cc:482] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:10.506448 24877 raft_consensus.cc:3037] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:10.507469 24877 raft_consensus.cc:504] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.507790 24877 leader_election.cc:288] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [CANDIDATE]: Term 1 election: Requested vote from peers 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079), d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871)
I20260923 14:41:10.508065 24728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b749761d0f114174928f995d102c7dfd" candidate_uuid: "16734ba172984ae68335d86eab1b3f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "786dedf7a34e45118f0ff8c612ce4dea"
I20260923 14:41:10.508193 24728 raft_consensus.cc:3037] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:10.508249 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b749761d0f114174928f995d102c7dfd" candidate_uuid: "16734ba172984ae68335d86eab1b3f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8d6c191d99f44bba8dadea90a9034a5"
I20260923 14:41:10.508381 24455 raft_consensus.cc:3037] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:10.509126 24728 raft_consensus.cc:2454] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16734ba172984ae68335d86eab1b3f22 in term 1.
I20260923 14:41:10.509255 24455 raft_consensus.cc:2454] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16734ba172984ae68335d86eab1b3f22 in term 1.
I20260923 14:41:10.509383 24526 leader_election.cc:302] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16734ba172984ae68335d86eab1b3f22, 786dedf7a34e45118f0ff8c612ce4dea; no voters:
I20260923 14:41:10.509564 24877 raft_consensus.cc:2781] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:10.509763 24877 raft_consensus.cc:686] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 1 LEADER]: Becoming Leader. State: Replica: 16734ba172984ae68335d86eab1b3f22, State: Running, Role: LEADER
I20260923 14:41:10.509984 24877 consensus_queue.cc:237] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } }
I20260923 14:41:10.510385 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.510180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:39111)
0923 14:41:10.510282 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.510327 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 14:41:10.511986 24137 catalog_manager.cc:5495] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16734ba172984ae68335d86eab1b3f22 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "16734ba172984ae68335d86eab1b3f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16734ba172984ae68335d86eab1b3f22" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44717 } health_report { overall_health: HEALTHY } } }
I20260923 14:41:10.532548 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.529736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44798 (local address 127.17.4.130:44717)
0923 14:41:10.529837 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:10.529840 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:10.529851 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:10.529942 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:10.529944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:10.529987 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:10.530081 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:10.530264 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.530688 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.531376 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:10.531565 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:10.531632 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:10.531900 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:10.532278 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:10.532355 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:10.532407 (+ 52us) server_negotiation.cc:299] Negotiation successful
0923 14:41:10.532445 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 14:41:10.534747 24455 raft_consensus.cc:1261] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Refusing update from remote peer 16734ba172984ae68335d86eab1b3f22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:10.535019 24728 raft_consensus.cc:1261] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Refusing update from remote peer 16734ba172984ae68335d86eab1b3f22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:10.535238 24880 consensus_queue.cc:1035] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d6c191d99f44bba8dadea90a9034a5" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 32871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:10.535578 24877 consensus_queue.cc:1035] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "786dedf7a34e45118f0ff8c612ce4dea" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 40079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:10.537065 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.536614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:46447)
0923 14:41:10.536950 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.537004 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255}
I20260923 14:41:10.537289 24503 heartbeater.cc:503] Master 127.17.4.189:36151 was elected leader, sending a full tablet report...
I20260923 14:41:10.538275 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.537926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:58777)
0923 14:41:10.538153 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.538207 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260923 14:41:10.540942 24876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.540701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.129:47487)
0923 14:41:10.540827 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.540884 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 14:41:10.541225 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.540701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.130:44661)
0923 14:41:10.541109 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.541167 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349}
I20260923 14:41:10.542152 24886 mvcc.cc:205] Tried to move back new op lower bound from 7332554631306178560 to 7332554631210868736. Current Snapshot: MvccSnapshot[applied={T|T < 7332554631306178560}]
I20260923 14:41:10.542287 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:10.541941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44463 (local address 127.17.4.131:51827)
0923 14:41:10.542154 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.542205 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260923 14:41:10.550109 24136 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:10.550261 24136 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:10.554071 24136 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8751807ba13b419e809a868d7c68c8a2: Sending DeleteTablet for 3 replicas of tablet b749761d0f114174928f995d102c7dfd
I20260923 14:41:10.554654 24708 tablet_service.cc:1514] Processing DeleteTablet for tablet b749761d0f114174928f995d102c7dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:10 UTC) from {username='oryx', principal='oryx/127.17.4.189@KRBTEST.COM'} at 127.0.0.1:36700
I20260923 14:41:10.554754 24435 tablet_service.cc:1514] Processing DeleteTablet for tablet b749761d0f114174928f995d102c7dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:10 UTC) from {username='oryx', principal='oryx/127.17.4.189@KRBTEST.COM'} at 127.0.0.1:39402
I20260923 14:41:10.555106 24894 tablet_replica.cc:330] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: stopping tablet replica
I20260923 14:41:10.555212 24572 tablet_service.cc:1514] Processing DeleteTablet for tablet b749761d0f114174928f995d102c7dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:10 UTC) from {username='oryx', principal='oryx/127.17.4.189@KRBTEST.COM'} at 127.0.0.1:44796
I20260923 14:41:10.555248 24894 raft_consensus.cc:2229] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:10.555315 24893 tablet_replica.cc:330] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: stopping tablet replica
I20260923 14:41:10.555373 24894 raft_consensus.cc:2258] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:10.555423 24893 raft_consensus.cc:2229] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:10.555528 24893 raft_consensus.cc:2258] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:10.555944 24895 tablet_replica.cc:330] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: stopping tablet replica
I20260923 14:41:10.556133 24895 raft_consensus.cc:2229] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:10.556224 24894 ts_tablet_manager.cc:1905] T b749761d0f114174928f995d102c7dfd P d8d6c191d99f44bba8dadea90a9034a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:10.556250 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 24282
I20260923 14:41:10.556944 24895 raft_consensus.cc:2258] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:10.557641 24895 ts_tablet_manager.cc:1905] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:10.560096 24895 ts_tablet_manager.cc:1918] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:10.560174 24895 log.cc:1196] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/b749761d0f114174928f995d102c7dfd
I20260923 14:41:10.560484 24895 ts_tablet_manager.cc:1939] T b749761d0f114174928f995d102c7dfd P 16734ba172984ae68335d86eab1b3f22: Deleting consensus metadata
I20260923 14:41:10.561134 24893 ts_tablet_manager.cc:1905] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:10.562932 24893 ts_tablet_manager.cc:1918] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:10.563027 24893 log.cc:1196] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/b749761d0f114174928f995d102c7dfd
I20260923 14:41:10.563275 24893 ts_tablet_manager.cc:1939] T b749761d0f114174928f995d102c7dfd P 786dedf7a34e45118f0ff8c612ce4dea: Deleting consensus metadata
I20260923 14:41:10.563671 24122 catalog_manager.cc:4841] TS 16734ba172984ae68335d86eab1b3f22 (127.17.4.130:44717): tablet b749761d0f114174928f995d102c7dfd (table test-table [id=0ebcadbfeb834622a939516ba7278c48]) successfully deleted
I20260923 14:41:10.564529 24123 catalog_manager.cc:4841] TS 786dedf7a34e45118f0ff8c612ce4dea (127.17.4.131:40079): tablet b749761d0f114174928f995d102c7dfd (table test-table [id=0ebcadbfeb834622a939516ba7278c48]) successfully deleted
W20260923 14:41:10.564913 24865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:10.563797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:32871 (local address 127.0.0.1:39410)
0923 14:41:10.563939 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:10.563950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:10.564017 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:10.564807 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:32871: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 14:41:10.565049 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 24509
W20260923 14:41:10.565109 24124 catalog_manager.cc:4584] TS d8d6c191d99f44bba8dadea90a9034a5 (127.17.4.129:32871): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b749761d0f114174928f995d102c7dfd: Network error: Client connection negotiation failed: client connection to 127.17.4.129:32871: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 14:41:10.570555 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 24645
I20260923 14:41:10.576913 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 24002
I20260923 14:41:10.582466 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 24110
2026-09-23T14:41:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5129 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:10 dist-test-slave-54kg krb5kdc[24898](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:10 dist-test-slave-54kg krb5kdc[24898](info): set up 2 sockets
Sep 23 14:41:10 dist-test-slave-54kg krb5kdc[24898](info): commencing operation
krb5kdc: starting...
W20260923 14:41:11.593694 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.988s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:11 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:11Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab.
Entry for principal oryx/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab.
I20260923 14:41:11.714679 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35971
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab
--principal=oryx/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:35971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:11.821753 24911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:11.822009 24911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:11.822084 24911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:11.825948 24911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:11.826025 24911 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 14:41:11.826053 24911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:11.826092 24911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:11.826124 24911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:11.826156 24911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:11.830740 24911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:35971
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.190.keytab
--principal=oryx/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:11.831610 24911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:11.832556 24911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:11.840222 24917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:11.840247 24916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:11.840230 24919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:11.840314 24911 server_base.cc:1034] running on GCE node
I20260923 14:41:11.841048 24911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:11.842031 24911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:11.843206 24911 hybrid_clock.cc:648] HybridClock initialized: now 1790174471843191 us; error 26 us; skew 500 ppm
Sep 23 14:41:11 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174471, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:11.845798 24911 init.cc:377] Logged in from keytab as oryx/127.17.4.190@KRBTEST.COM (short username oryx)
I20260923 14:41:11.846630 24911 webserver.cc:460] Webserver started at http://127.17.4.190:41297/ using document root <none> and password file <none>
I20260923 14:41:11.847146 24911 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:11.847231 24911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:11.847445 24911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:11.849373 24911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "4f3d51624a264340b86475881d2f98f6"
format_stamp: "Formatted at 2026-09-23 14:41:11 on dist-test-slave-54kg"
server_key: "708738a066983416e8892de7c6c4f91b"
server_key_iv: "f263c2e5961b4ed7afbb92b3128eb342"
server_key_version: "encryptionkey@0"
I20260923 14:41:11.849901 24911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "4f3d51624a264340b86475881d2f98f6"
format_stamp: "Formatted at 2026-09-23 14:41:11 on dist-test-slave-54kg"
server_key: "708738a066983416e8892de7c6c4f91b"
server_key_iv: "f263c2e5961b4ed7afbb92b3128eb342"
server_key_version: "encryptionkey@0"
I20260923 14:41:11.853188 24911 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:41:11.855350 24926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:11.856523 24911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:11.856647 24911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "4f3d51624a264340b86475881d2f98f6"
format_stamp: "Formatted at 2026-09-23 14:41:11 on dist-test-slave-54kg"
server_key: "708738a066983416e8892de7c6c4f91b"
server_key_iv: "f263c2e5961b4ed7afbb92b3128eb342"
server_key_version: "encryptionkey@0"
I20260923 14:41:11.856743 24911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:11.866664 24911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:11.869120 24911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:11.869293 24911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:11.876247 24911 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:35971
I20260923 14:41:11.876267 24988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:35971 every 8 connection(s)
I20260923 14:41:11.877013 24911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:11.879482 24989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:11.879612 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 24911
I20260923 14:41:11.879763 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:11.880049 17426 external_mini_cluster.cc:1428] Setting key 5aad128a4cb21e3cc2a307cdeceed331
I20260923 14:41:11.886184 24989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Bootstrap starting.
I20260923 14:41:11.888667 24989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Neither blocks nor log segments found. Creating new log.
Sep 23 14:41:11 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:11.889521 24989 log.cc:824] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:11.891353 24989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: No bootstrap required, opened a new log
I20260923 14:41:11.894277 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:11.881307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.17.4.190:35971)
0923 14:41:11.881697 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:11.881715 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:11.881755 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:41:11.882603 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:11.882626 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:11.883017 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:11.883352 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:11.884007 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:11.885497 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:11.886294 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:11.886929 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:11.887102 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:11.889711 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:11.889716 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:11.889727 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:11.889750 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:11.891734 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:11.892215 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:11.892219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:11.892223 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:11.892318 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:11.892600 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:11.892602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:11.892603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:11.892922 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:11.893044 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:11.893352 (+ 308us) server_negotiation.cc:299] Negotiation successful
0923 14:41:11.893618 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":88,"threads_started":1}
I20260923 14:41:11.894838 24989 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3d51624a264340b86475881d2f98f6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35971 } }
I20260923 14:41:11.895045 24989 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:11.895107 24989 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3d51624a264340b86475881d2f98f6, State: Initialized, Role: FOLLOWER
I20260923 14:41:11.895562 24989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3d51624a264340b86475881d2f98f6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35971 } }
I20260923 14:41:11.895714 24989 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:11.895802 24989 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:11.895896 24989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:11.896689 24989 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3d51624a264340b86475881d2f98f6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35971 } }
I20260923 14:41:11.896942 24989 leader_election.cc:302] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f3d51624a264340b86475881d2f98f6; no voters:
I20260923 14:41:11.897147 24989 leader_election.cc:288] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:11.897255 24994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:11.897456 24994 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3d51624a264340b86475881d2f98f6, State: Running, Role: LEADER
I20260923 14:41:11.897758 24994 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3d51624a264340b86475881d2f98f6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35971 } }
I20260923 14:41:11.898279 24989 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:11.899375 24996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f3d51624a264340b86475881d2f98f6. Latest consensus state: current_term: 1 leader_uuid: "4f3d51624a264340b86475881d2f98f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3d51624a264340b86475881d2f98f6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35971 } } }
I20260923 14:41:11.899379 24995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f3d51624a264340b86475881d2f98f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3d51624a264340b86475881d2f98f6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35971 } } }
I20260923 14:41:11.899501 24995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:11.899503 24996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:11.900377 25003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:11.903326 25003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:11.908397 25003 catalog_manager.cc:1347] Generated new cluster ID: 8b0a2d8c3edf4e42ab5563ed51037bc5
I20260923 14:41:11.908454 25003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:11.926784 25003 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:11.927914 25003 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:11.933956 25003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Generated new TSK 0
I20260923 14:41:11.934544 25003 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab.
Entry for principal oryx/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab.
I20260923 14:41:11.966913 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35971
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:12.072525 25015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:12.072777 25015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:12.072850 25015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:12.076630 25015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:12.076694 25015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:12.076756 25015 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:41:12.076825 25015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:12.081789 25015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:35971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:12.082651 25015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:12.083542 25015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:12.092217 25021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:12.092233 25023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:12.092233 25020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:12.092440 25015 server_base.cc:1034] running on GCE node
I20260923 14:41:12.092854 25015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:12.093405 25015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:12.094589 25015 hybrid_clock.cc:648] HybridClock initialized: now 1790174472094570 us; error 47 us; skew 500 ppm
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:12.097307 25015 init.cc:377] Logged in from keytab as oryx/127.17.4.129@KRBTEST.COM (short username oryx)
I20260923 14:41:12.098119 25015 webserver.cc:460] Webserver started at http://127.17.4.129:45983/ using document root <none> and password file <none>
I20260923 14:41:12.098644 25015 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:12.098722 25015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:12.098917 25015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:12.100971 25015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "360543979ee64322bc4a0a23d5989789"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "ecf87a666dd6e4beb84d7e77759c8f75"
server_key_iv: "39c8b1aefb093fc32cabd23598bf7ec6"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.101528 25015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "360543979ee64322bc4a0a23d5989789"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "ecf87a666dd6e4beb84d7e77759c8f75"
server_key_iv: "39c8b1aefb093fc32cabd23598bf7ec6"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.104924 25015 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:41:12.107131 25030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:12.108258 25015 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:12.108367 25015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "360543979ee64322bc4a0a23d5989789"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "ecf87a666dd6e4beb84d7e77759c8f75"
server_key_iv: "39c8b1aefb093fc32cabd23598bf7ec6"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.108456 25015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:12.137857 25015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:12.140908 25015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:12.141099 25015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:12.142408 25015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:12.142477 25015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:12.142553 25015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:12.142594 25015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:12.153200 25015 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:34405
I20260923 14:41:12.153985 25015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:12.154791 25145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:34405 every 8 connection(s)
I20260923 14:41:12.156289 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.143149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:49595 (local address 127.17.4.190:35971)
0923 14:41:12.143362 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.143365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.144266 (+ 901us) server_negotiation.cc:407] Connection header received
0923 14:41:12.145181 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.145184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.145242 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.145322 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.146870 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.147684 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.149638 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.149878 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.150007 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.152602 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.152605 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.152607 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.152628 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.154274 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.154884 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.154888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.154889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.154983 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.155277 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.155280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.155281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.155454 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.155529 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.156060 (+ 531us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.156171 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260923 14:41:12.156966 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.143636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.17.4.129:49595)
0923 14:41:12.144129 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.144168 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.144975 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.145625 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.145635 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.146155 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:12.146732 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.146753 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.147875 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.147882 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.149483 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.149497 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.150057 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.150062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.150225 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.150730 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:12.150745 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:12.152448 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:12.154404 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.154411 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.154424 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.154772 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.155073 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.155075 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.155077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.155194 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.155585 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:12.155590 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:12.155841 (+ 251us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.156013 (+ 172us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.156241 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":153,"threads_started":1}
I20260923 14:41:12.158196 25146 heartbeater.cc:347] Connected to a master server at 127.17.4.190:35971
I20260923 14:41:12.158349 25146 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:12.158856 25146 heartbeater.cc:511] Master 127.17.4.190:35971 requested a full tablet report, sending...
I20260923 14:41:12.160377 24942 ts_manager.cc:194] Registered new tserver with Master: 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405)
I20260923 14:41:12.161509 24942 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:49595
I20260923 14:41:12.162631 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25015
I20260923 14:41:12.162761 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:12.163075 17426 external_mini_cluster.cc:1428] Setting key c6d2504c47fcce949267545d5fb6a55f
I20260923 14:41:12.167852 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.160446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:50423 (local address 127.17.4.190:35971)
0923 14:41:12.160559 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.160564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.160759 (+ 195us) server_negotiation.cc:407] Connection header received
0923 14:41:12.160935 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.160944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.160983 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.161073 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.161475 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.162090 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.163209 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.163561 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.163666 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.164908 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.164911 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.164913 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.164932 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.166325 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.166728 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.166733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.166735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.166815 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.167084 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.167088 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.167090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.167251 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.167352 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.167592 (+ 240us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.167692 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:41:12.167860 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.160404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.17.4.129:50423)
0923 14:41:12.160666 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.160678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.160829 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.161088 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.161091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.161269 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:12.161358 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.161364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.162211 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.162213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.163053 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.163064 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.163678 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.163681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.163809 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.164289 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:12.164343 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:12.164782 (+ 439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:12.166432 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.166436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.166438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.166630 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.166902 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.166906 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.166907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.166996 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.167344 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:12.167347 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:12.167437 (+ 90us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.167543 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.167670 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for oryx/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab.
Entry for principal oryx/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab.
I20260923 14:41:12.190054 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35971
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:12.293900 25155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:12.294131 25155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:12.294170 25155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:12.297928 25155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:12.297969 25155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:12.298059 25155 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:41:12.298120 25155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:12.303247 25155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:35971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:12.304065 25155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:12.304957 25155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:12.313889 25160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:12.313958 25155 server_base.cc:1034] running on GCE node
W20260923 14:41:12.313894 25161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:12.313894 25163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:12.314345 25155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:12.314939 25155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:12.316100 25155 hybrid_clock.cc:648] HybridClock initialized: now 1790174472316052 us; error 43 us; skew 500 ppm
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:12.318715 25155 init.cc:377] Logged in from keytab as oryx/127.17.4.130@KRBTEST.COM (short username oryx)
I20260923 14:41:12.319486 25155 webserver.cc:460] Webserver started at http://127.17.4.130:34489/ using document root <none> and password file <none>
I20260923 14:41:12.320019 25155 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:12.320078 25155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:12.320226 25155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:12.322005 25155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "124acf59a169494cab4355376e2457ba"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "ebdb409d6e9a0847e3da6ad5f116d4e4"
server_key_iv: "224f649c8f340f7a27a4214f249ecc2a"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.322468 25155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "124acf59a169494cab4355376e2457ba"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "ebdb409d6e9a0847e3da6ad5f116d4e4"
server_key_iv: "224f649c8f340f7a27a4214f249ecc2a"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.325765 25155 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:41:12.327886 25170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:12.328974 25155 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:12.329107 25155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "124acf59a169494cab4355376e2457ba"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "ebdb409d6e9a0847e3da6ad5f116d4e4"
server_key_iv: "224f649c8f340f7a27a4214f249ecc2a"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.329208 25155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:12.358966 25155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:12.361974 25155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:12.362159 25155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:12.363430 25155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:12.363503 25155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:12.363598 25155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:12.363648 25155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:12.374485 25155 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:36201
I20260923 14:41:12.374558 25285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:36201 every 8 connection(s)
I20260923 14:41:12.375372 25155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:12.376895 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.364279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:47473 (local address 127.17.4.190:35971)
0923 14:41:12.364394 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.364397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.365372 (+ 975us) server_negotiation.cc:407] Connection header received
0923 14:41:12.366242 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.366245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.366303 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.366385 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.367822 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.368561 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.369919 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.370179 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.370282 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.373302 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.373308 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.373315 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.373337 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.374878 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.375367 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.375371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.375373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.375457 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.375832 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.375835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.375837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.376043 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.376131 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.376637 (+ 506us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.376743 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:41:12.377604 25179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.364795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.17.4.130:47473)
0923 14:41:12.365242 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.365279 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.366050 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.366643 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.366652 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.367147 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:12.367665 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.367678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.368687 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.368691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.369803 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.369812 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.370320 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.370323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.370510 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.371194 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:12.371214 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:12.373144 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:12.374988 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.374993 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.375008 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.375249 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.375547 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.375551 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.375553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.375705 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.376214 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:12.376218 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:12.376404 (+ 186us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.376590 (+ 186us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.376849 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":139,"threads_started":1}
I20260923 14:41:12.378664 25286 heartbeater.cc:347] Connected to a master server at 127.17.4.190:35971
I20260923 14:41:12.378808 25286 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:12.379238 25286 heartbeater.cc:511] Master 127.17.4.190:35971 requested a full tablet report, sending...
I20260923 14:41:12.380175 24943 ts_manager.cc:194] Registered new tserver with Master: 124acf59a169494cab4355376e2457ba (127.17.4.130:36201)
I20260923 14:41:12.380932 24943 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:47473
I20260923 14:41:12.385169 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25155
I20260923 14:41:12.385311 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:12.385607 17426 external_mini_cluster.cc:1428] Setting key c1f16ab744b0226dc9f040ffdb3cfece
I20260923 14:41:12.387346 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.380622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:43629 (local address 127.17.4.190:35971)
0923 14:41:12.380746 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.380750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.380923 (+ 173us) server_negotiation.cc:407] Connection header received
0923 14:41:12.381057 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.381066 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.381103 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.381164 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.381652 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.382360 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.383095 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.383285 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.383358 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.384295 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.384298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.384299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.384318 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.385804 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.386207 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.386210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.386212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.386286 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.386572 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.386575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.386577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.386770 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.386887 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.387130 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.387223 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:41:12.387351 25292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.380563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.17.4.130:43629)
0923 14:41:12.380838 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.380852 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.380944 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.381208 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.381211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.381406 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:12.381519 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.381526 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.382472 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.382474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.382994 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.383000 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.383375 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.383377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.383437 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.383914 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:12.383924 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:12.384183 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:12.385907 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.385912 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.385913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.386103 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.386375 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.386379 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.386380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.386464 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.386880 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:12.386882 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:12.386965 (+ 83us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.387070 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.387190 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for oryx/127.17.4.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab.
Entry for principal oryx/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab.
I20260923 14:41:12.411173 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:35971
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:12.514626 25295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:12.514896 25295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:12.514978 25295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:12.518971 25295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:12.519028 25295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:12.519105 25295 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 14:41:12.519191 25295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:12.524288 25295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.4.190:35971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:12.525311 25295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:12.526327 25295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:12.536047 25301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:12.536055 25300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:12.536130 25295 server_base.cc:1034] running on GCE node
W20260923 14:41:12.536055 25303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:12.536769 25295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:12.537325 25295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:12.538479 25295 hybrid_clock.cc:648] HybridClock initialized: now 1790174472538467 us; error 25 us; skew 500 ppm
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:12.541260 25295 init.cc:377] Logged in from keytab as oryx/127.17.4.131@KRBTEST.COM (short username oryx)
I20260923 14:41:12.542172 25295 webserver.cc:460] Webserver started at http://127.17.4.131:46133/ using document root <none> and password file <none>
I20260923 14:41:12.542742 25295 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:12.542831 25295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:12.543063 25295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:12.545097 25295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "4307f93a3e574e8d8d0125982fbc77ae"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "d6aec991ac92642aa2110b0d03215312"
server_key_iv: "3ef45607fda755baf50b2935c2010785"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.545668 25295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "4307f93a3e574e8d8d0125982fbc77ae"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "d6aec991ac92642aa2110b0d03215312"
server_key_iv: "3ef45607fda755baf50b2935c2010785"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.549345 25295 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:41:12.551718 25310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:12.552949 25295 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:12.553110 25295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "4307f93a3e574e8d8d0125982fbc77ae"
format_stamp: "Formatted at 2026-09-23 14:41:12 on dist-test-slave-54kg"
server_key: "d6aec991ac92642aa2110b0d03215312"
server_key_iv: "3ef45607fda755baf50b2935c2010785"
server_key_version: "encryptionkey@0"
I20260923 14:41:12.553224 25295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:12.571713 25295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:12.574918 25295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:12.575126 25295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:12.576669 25295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:12.576749 25295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:12.576802 25295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:12.576831 25295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:12.587416 25295 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:45857
I20260923 14:41:12.587917 25425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:45857 every 8 connection(s)
I20260923 14:41:12.588340 25295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:12.590735 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.577248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:45705 (local address 127.17.4.190:35971)
0923 14:41:12.577365 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.577375 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.578419 (+ 1044us) server_negotiation.cc:407] Connection header received
0923 14:41:12.579401 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.579404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.579463 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.579539 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.581045 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.581883 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.583625 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.583982 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.584094 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.586913 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.586916 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.586919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.586945 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.588488 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.589024 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.589029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.589031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.589168 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.589525 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.589530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.589533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.589745 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.589843 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.590398 (+ 555us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.590541 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:41:12.591526 25319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.577816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.17.4.131:45705)
0923 14:41:12.578275 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.578315 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.579202 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.579708 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.579717 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.580209 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:12.580904 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.580919 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.582018 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.582023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.583467 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.583481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.584153 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.584159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.584365 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.584906 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:12.584928 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:12.586758 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:12.588585 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.588592 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.588604 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.588915 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.589267 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.589271 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.589273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.589421 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.589862 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:12.589867 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:12.590147 (+ 280us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.590336 (+ 189us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.590620 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":134,"threads_started":1}
I20260923 14:41:12.592760 25426 heartbeater.cc:347] Connected to a master server at 127.17.4.190:35971
I20260923 14:41:12.592895 25426 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:12.593390 25426 heartbeater.cc:511] Master 127.17.4.190:35971 requested a full tablet report, sending...
I20260923 14:41:12.594448 24942 ts_manager.cc:194] Registered new tserver with Master: 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:12.595211 24942 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:45705
I20260923 14:41:12.596627 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25295
I20260923 14:41:12.596755 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:12.597074 17426 external_mini_cluster.cc:1428] Setting key fc84e3bb86b84e00883b2127290b7938
I20260923 14:41:12.599232 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:41:12.602144 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.594971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:33405 (local address 127.17.4.190:35971)
0923 14:41:12.595085 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.595089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.595335 (+ 246us) server_negotiation.cc:407] Connection header received
0923 14:41:12.595438 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.595441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.595484 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.595591 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.596094 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.596799 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.597814 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.598111 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.598223 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.599293 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.599296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.599299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.599331 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.600635 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.601028 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.601033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.601035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.601120 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.601394 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.601397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.601399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.601553 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.601659 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.601905 (+ 246us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.602002 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:41:12.602152 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.594906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.17.4.131:33405)
0923 14:41:12.595217 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.595228 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.595350 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.595629 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.595632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.595853 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:12.595974 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.595981 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.596908 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.596911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.597672 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.597681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.598226 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.598230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.598316 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.598762 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:12.598775 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:12.599169 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:12.600738 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.600742 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.600744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.600926 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.601207 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:12.601211 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:12.601212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:12.601294 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:12.601650 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:12.601653 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:12.601745 (+ 92us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.601844 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.601972 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":100,"threads_started":1}
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
W20260923 14:41:12.621995 24992 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:12.616359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.17.4.190:35971)
0923 14:41:12.616471 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.616474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.616485 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:12.616515 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.616517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.616547 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.616616 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.617247 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.617760 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.618574 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.618783 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.618849 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.621868 (+ 3019us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37304: BlockingRecv error: recv got EOF from 127.0.0.1:37304 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 23 14:41:12 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174472, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:12.630282 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.623492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.17.4.190:35971)
0923 14:41:12.623618 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.623621 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.623675 (+ 54us) server_negotiation.cc:407] Connection header received
0923 14:41:12.623758 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.623818 (+ 60us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.623850 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.623910 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:12.624420 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.624878 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.625569 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.625757 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.625825 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.627748 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:12.627751 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:12.627753 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:12.627823 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:12.628985 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.629335 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.629337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.629339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.629401 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:12.629628 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:12.629629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:12.629630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:12.629764 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:12.629853 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.630022 (+ 169us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.630104 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:41:12.632721 24942 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:12.635689 24942 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:12.648874 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.643968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47636 (local address 127.17.4.131:45857)
0923 14:41:12.644332 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.644342 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.644794 (+ 452us) server_negotiation.cc:407] Connection header received
0923 14:41:12.644913 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.644918 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.645105 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.645246 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:12.645568 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.646383 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.647731 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.648279 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.648396 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.648553 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.648662 (+ 109us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.648750 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":151,"threads_started":1}
I20260923 14:41:12.648852 25448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.643129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34405 (local address 127.0.0.1:36346)
0923 14:41:12.643574 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.643615 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.643723 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.644492 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.644498 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.644515 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:12.644628 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.644635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.645938 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.645942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.647266 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.647275 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.648314 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.648318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.648452 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.648500 (+ 48us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.648589 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.648703 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":5,"thread_start_us":64,"threads_started":1}
I20260923 14:41:12.648840 25449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.643650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45857 (local address 127.0.0.1:47636)
0923 14:41:12.644676 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.644688 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.644790 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.645343 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.645349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.645366 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:12.645454 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.645462 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.646510 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.646513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.647625 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.647633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.648396 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.648400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.648518 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.648548 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.648634 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.648707 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"mutex_wait_us":76,"thread_start_us":137,"threads_started":1}
I20260923 14:41:12.649523 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.643875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58660 (local address 127.17.4.130:36201)
0923 14:41:12.644503 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.644513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.644533 (+ 20us) server_negotiation.cc:407] Connection header received
0923 14:41:12.644904 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.644909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.645044 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.645199 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:12.645401 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.646357 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.647783 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.648559 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.648648 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.648786 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.649305 (+ 519us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.649387 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":124,"threads_started":1}
I20260923 14:41:12.649533 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.643275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36346 (local address 127.17.4.129:34405)
0923 14:41:12.643963 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.643978 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.644028 (+ 50us) server_negotiation.cc:407] Connection header received
0923 14:41:12.644141 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.644146 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.644359 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.644516 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:12.644773 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.645820 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.647391 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.648179 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.648920 (+ 741us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.649249 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.649304 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.649387 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":78,"threads_started":1}
I20260923 14:41:12.649223 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.643203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:36201 (local address 127.0.0.1:58660)
0923 14:41:12.644345 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.644358 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.644735 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.645174 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.645177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.645193 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:12.645277 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.645284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.646486 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.646489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.647608 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.647618 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.648844 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.648847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.648928 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.648947 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.649027 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.649096 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1090,"mutex_wait_us":2,"thread_start_us":97,"threads_started":1}
I20260923 14:41:12.651763 25202 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 (DEFAULT_TABLE table=test-table [id=77535631bc8840cc9eac52a23f9187a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:12.651901 25080 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 (DEFAULT_TABLE table=test-table [id=77535631bc8840cc9eac52a23f9187a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:12.651901 25360 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 (DEFAULT_TABLE table=test-table [id=77535631bc8840cc9eac52a23f9187a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:12.652788 25202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:12.652812 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:12.652812 25360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:12.660022 25454 tablet_bootstrap.cc:492] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Bootstrap starting.
I20260923 14:41:12.661060 25455 tablet_bootstrap.cc:492] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Bootstrap starting.
I20260923 14:41:12.661300 25456 tablet_bootstrap.cc:492] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Bootstrap starting.
I20260923 14:41:12.662256 25454 tablet_bootstrap.cc:654] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:12.662691 25455 tablet_bootstrap.cc:654] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:12.663074 25454 log.cc:824] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:12.663200 25456 tablet_bootstrap.cc:654] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:12.663422 25455 log.cc:824] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:12.664016 25456 log.cc:824] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:12.665241 25455 tablet_bootstrap.cc:492] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: No bootstrap required, opened a new log
I20260923 14:41:12.665443 25455 ts_tablet_manager.cc:1397] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 14:41:12.665800 25454 tablet_bootstrap.cc:492] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: No bootstrap required, opened a new log
I20260923 14:41:12.665800 25456 tablet_bootstrap.cc:492] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: No bootstrap required, opened a new log
I20260923 14:41:12.665984 25454 ts_tablet_manager.cc:1397] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:41:12.665982 25456 ts_tablet_manager.cc:1397] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 14:41:12.668097 25455 raft_consensus.cc:348] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.668346 25455 raft_consensus.cc:374] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:12.668416 25455 raft_consensus.cc:729] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Initialized, Role: FOLLOWER
I20260923 14:41:12.668833 25455 consensus_queue.cc:260] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.669448 25456 raft_consensus.cc:348] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.669448 25454 raft_consensus.cc:348] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.669664 25454 raft_consensus.cc:374] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:12.669700 25456 raft_consensus.cc:374] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:12.669752 25454 raft_consensus.cc:729] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124acf59a169494cab4355376e2457ba, State: Initialized, Role: FOLLOWER
I20260923 14:41:12.669775 25456 raft_consensus.cc:729] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4307f93a3e574e8d8d0125982fbc77ae, State: Initialized, Role: FOLLOWER
I20260923 14:41:12.669823 25455 ts_tablet_manager.cc:1428] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260923 14:41:12.670153 25456 consensus_queue.cc:260] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.670153 25454 consensus_queue.cc:260] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.670234 25146 heartbeater.cc:503] Master 127.17.4.190:35971 was elected leader, sending a full tablet report...
I20260923 14:41:12.670928 25426 heartbeater.cc:503] Master 127.17.4.190:35971 was elected leader, sending a full tablet report...
I20260923 14:41:12.671096 25456 ts_tablet_manager.cc:1428] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:41:12.671293 25454 ts_tablet_manager.cc:1428] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:41:12.671959 25286 heartbeater.cc:503] Master 127.17.4.190:35971 was elected leader, sending a full tablet report...
W20260923 14:41:12.839506 25427 tablet.cc:2369] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:12.849896 25461 raft_consensus.cc:482] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:12.850100 25461 raft_consensus.cc:504] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.851236 25461 leader_election.cc:288] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:12.854600 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.851659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:59913 (local address 127.17.4.129:34405)
0923 14:41:12.851815 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.851819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.851837 (+ 18us) server_negotiation.cc:407] Connection header received
0923 14:41:12.851880 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.851883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.851921 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.851999 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:12.852251 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.852729 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.853716 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.854083 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.854200 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.854253 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.854425 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.854490 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:41:12.854609 25179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.851448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34405 (local address 127.17.4.130:59913)
0923 14:41:12.851603 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.851619 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.851710 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.852011 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.852013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.852030 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:12.852144 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.852149 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.852829 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.852835 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.853596 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.853604 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.854190 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.854193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.854301 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.854319 (+ 18us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.854400 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.854473 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":2}
I20260923 14:41:12.855187 25100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a1e3cd7eb4af0a371a8b4f0f14a61" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360543979ee64322bc4a0a23d5989789" is_pre_election: true
I20260923 14:41:12.855293 25463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.851484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45857 (local address 127.17.4.130:41817)
0923 14:41:12.851854 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:12.851865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:12.851987 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:12.852246 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:12.852248 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:12.852263 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:12.852387 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.852392 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.853079 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.853084 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.854165 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:12.854174 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.854879 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.854883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:12.854990 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.855015 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:41:12.855103 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 14:41:12.855164 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":83,"threads_started":1}
I20260923 14:41:12.855285 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.851578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41817 (local address 127.17.4.131:45857)
0923 14:41:12.851713 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.851717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.851940 (+ 223us) server_negotiation.cc:407] Connection header received
0923 14:41:12.852103 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.852105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.852146 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.852222 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:12.852497 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.852974 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.854302 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.854741 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.854877 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.854921 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.855117 (+ 196us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.855185 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:41:12.855489 25100 raft_consensus.cc:2454] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 0.
I20260923 14:41:12.855875 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a1e3cd7eb4af0a371a8b4f0f14a61" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae" is_pre_election: true
I20260923 14:41:12.856032 25172 leader_election.cc:302] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 360543979ee64322bc4a0a23d5989789; no voters:
I20260923 14:41:12.856154 25380 raft_consensus.cc:2454] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 0.
I20260923 14:41:12.856381 25461 raft_consensus.cc:2781] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:12.856479 25461 raft_consensus.cc:482] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:12.856534 25461 raft_consensus.cc:3037] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:12.857657 25461 raft_consensus.cc:504] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.858016 25461 leader_election.cc:288] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 election: Requested vote from peers 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:12.858338 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a1e3cd7eb4af0a371a8b4f0f14a61" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae"
I20260923 14:41:12.858350 25100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a1e3cd7eb4af0a371a8b4f0f14a61" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360543979ee64322bc4a0a23d5989789"
I20260923 14:41:12.858472 25100 raft_consensus.cc:3037] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:12.858472 25380 raft_consensus.cc:3037] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:12.859792 25100 raft_consensus.cc:2454] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 1.
I20260923 14:41:12.860059 25172 leader_election.cc:302] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 360543979ee64322bc4a0a23d5989789; no voters:
I20260923 14:41:12.860164 25380 raft_consensus.cc:2454] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 1.
I20260923 14:41:12.860383 25461 raft_consensus.cc:2781] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:12.860592 25461 raft_consensus.cc:686] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 1 LEADER]: Becoming Leader. State: Replica: 124acf59a169494cab4355376e2457ba, State: Running, Role: LEADER
I20260923 14:41:12.860919 25461 consensus_queue.cc:237] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.864050 24941 catalog_manager.cc:5495] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 124acf59a169494cab4355376e2457ba (127.17.4.130). New cstate: current_term: 1 leader_uuid: "124acf59a169494cab4355376e2457ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
W20260923 14:41:12.876446 25287 tablet.cc:2369] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:12.885063 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:12.881501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58668 (local address 127.17.4.130:36201)
0923 14:41:12.881599 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:12.881602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:12.881653 (+ 51us) server_negotiation.cc:407] Connection header received
0923 14:41:12.881768 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:12.881771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:12.881823 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:12.881920 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:12.882106 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.882863 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.883630 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:12.883983 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:12.884077 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:12.884274 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:12.884709 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:12.884812 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:12.884894 (+ 82us) server_negotiation.cc:299] Negotiation successful
0923 14:41:12.884942 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260923 14:41:12.890476 25100 raft_consensus.cc:1261] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Refusing update from remote peer 124acf59a169494cab4355376e2457ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:12.890558 25380 raft_consensus.cc:1261] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Refusing update from remote peer 124acf59a169494cab4355376e2457ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:12.891152 25464 consensus_queue.cc:1035] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:12.891371 25461 consensus_queue.cc:1035] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:12.898849 25469 mvcc.cc:205] Tried to move back new op lower bound from 7332554640953253888 to 7332554640840908800. Current Snapshot: MvccSnapshot[applied={T|T < 7332554640953253888}]
I20260923 14:41:12.906454 24941 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:12.906606 24941 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:12.908732 24941 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Sending DeleteTablet for 3 replicas of tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61
I20260923 14:41:12.909382 25080 tablet_service.cc:1514] Processing DeleteTablet for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:12 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:36346
I20260923 14:41:12.909421 25202 tablet_service.cc:1514] Processing DeleteTablet for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:12 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58660
I20260923 14:41:12.910063 25360 tablet_service.cc:1514] Processing DeleteTablet for tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:12 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:47636
I20260923 14:41:12.910404 25476 tablet_replica.cc:330] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: stopping tablet replica
I20260923 14:41:12.910580 24941 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 14:41:12.910753 25476 raft_consensus.cc:2229] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260923 14:41:12.910991 24941 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:12.911002 25476 raft_consensus.cc:2258] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:12.911258 25477 tablet_replica.cc:330] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: stopping tablet replica
I20260923 14:41:12.911590 25477 raft_consensus.cc:2229] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:12.911899 25477 raft_consensus.cc:2258] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:12.912969 25476 ts_tablet_manager.cc:1905] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:12.915135 25080 tablet_service.cc:1467] Processing CreateTablet for tablet 1790edf582a643af84942cbea5385828 (DEFAULT_TABLE table=test-table [id=2cdf0d384bb34f8f90e15a65c34d448e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:12.915364 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1790edf582a643af84942cbea5385828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:12.915426 25202 tablet_service.cc:1467] Processing CreateTablet for tablet 1790edf582a643af84942cbea5385828 (DEFAULT_TABLE table=test-table [id=2cdf0d384bb34f8f90e15a65c34d448e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:12.915519 25360 tablet_service.cc:1467] Processing CreateTablet for tablet 1790edf582a643af84942cbea5385828 (DEFAULT_TABLE table=test-table [id=2cdf0d384bb34f8f90e15a65c34d448e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:12.915660 25202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1790edf582a643af84942cbea5385828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:12.915745 25360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1790edf582a643af84942cbea5385828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:12.918125 25454 tablet_bootstrap.cc:492] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Bootstrap starting.
I20260923 14:41:12.918233 25476 ts_tablet_manager.cc:1918] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:12.918320 25476 log.cc:1196] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/ce7a1e3cd7eb4af0a371a8b4f0f14a61
I20260923 14:41:12.918329 25456 tablet_bootstrap.cc:492] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Bootstrap starting.
I20260923 14:41:12.918630 25476 ts_tablet_manager.cc:1939] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 360543979ee64322bc4a0a23d5989789: Deleting consensus metadata
I20260923 14:41:12.919142 25456 tablet_bootstrap.cc:654] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:12.919154 25454 tablet_bootstrap.cc:654] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:12.918241 25455 tablet_bootstrap.cc:492] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Bootstrap starting.
I20260923 14:41:12.919718 24928 catalog_manager.cc:4841] TS 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405): tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 (table test-table [id=77535631bc8840cc9eac52a23f9187a3]) successfully deleted
I20260923 14:41:12.920425 25455 tablet_bootstrap.cc:654] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:12.920818 25477 ts_tablet_manager.cc:1905] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:12.922042 25455 tablet_bootstrap.cc:492] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: No bootstrap required, opened a new log
I20260923 14:41:12.922142 25455 ts_tablet_manager.cc:1397] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260923 14:41:12.920022 25478 tablet_replica.cc:330] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: stopping tablet replica
I20260923 14:41:12.921696 25456 tablet_bootstrap.cc:492] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: No bootstrap required, opened a new log
I20260923 14:41:12.922730 25456 ts_tablet_manager.cc:1397] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260923 14:41:12.922878 25478 raft_consensus.cc:2229] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:12.922910 25455 raft_consensus.cc:348] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.923013 25455 raft_consensus.cc:374] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:12.923046 25455 raft_consensus.cc:729] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Initialized, Role: FOLLOWER
I20260923 14:41:12.923154 25478 raft_consensus.cc:2258] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:12.923153 25455 consensus_queue.cc:260] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.923184 25456 raft_consensus.cc:348] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.923271 25456 raft_consensus.cc:374] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:12.923300 25456 raft_consensus.cc:729] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4307f93a3e574e8d8d0125982fbc77ae, State: Initialized, Role: FOLLOWER
I20260923 14:41:12.923403 25455 ts_tablet_manager.cc:1428] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260923 14:41:12.923403 25456 consensus_queue.cc:260] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.923761 25456 ts_tablet_manager.cc:1428] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:12.924444 25478 ts_tablet_manager.cc:1905] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:12.926692 25478 ts_tablet_manager.cc:1918] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:12.926783 25478 log.cc:1196] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/ce7a1e3cd7eb4af0a371a8b4f0f14a61
I20260923 14:41:12.927026 25478 ts_tablet_manager.cc:1939] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 4307f93a3e574e8d8d0125982fbc77ae: Deleting consensus metadata
I20260923 14:41:12.928049 24927 catalog_manager.cc:4841] TS 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857): tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 (table test-table [id=77535631bc8840cc9eac52a23f9187a3]) successfully deleted
I20260923 14:41:12.928406 25477 ts_tablet_manager.cc:1918] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:12.928478 25477 log.cc:1196] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/ce7a1e3cd7eb4af0a371a8b4f0f14a61
I20260923 14:41:12.928746 25477 ts_tablet_manager.cc:1939] T ce7a1e3cd7eb4af0a371a8b4f0f14a61 P 124acf59a169494cab4355376e2457ba: Deleting consensus metadata
I20260923 14:41:12.929824 24929 catalog_manager.cc:4841] TS 124acf59a169494cab4355376e2457ba (127.17.4.130:36201): tablet ce7a1e3cd7eb4af0a371a8b4f0f14a61 (table test-table [id=77535631bc8840cc9eac52a23f9187a3]) successfully deleted
I20260923 14:41:12.932690 25454 tablet_bootstrap.cc:492] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: No bootstrap required, opened a new log
I20260923 14:41:12.932787 25454 ts_tablet_manager.cc:1397] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260923 14:41:12.933200 25454 raft_consensus.cc:348] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.933283 25454 raft_consensus.cc:374] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:12.933302 25454 raft_consensus.cc:729] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124acf59a169494cab4355376e2457ba, State: Initialized, Role: FOLLOWER
I20260923 14:41:12.933441 25454 consensus_queue.cc:260] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:12.933683 25454 ts_tablet_manager.cc:1428] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 14:41:13.001514 25462 raft_consensus.cc:482] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:13.001639 25462 raft_consensus.cc:504] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.002863 25462 leader_election.cc:288] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405), 124acf59a169494cab4355376e2457ba (127.17.4.130:36201)
I20260923 14:41:13.007259 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.003584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:38207 (local address 127.17.4.130:36201)
0923 14:41:13.003724 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.003728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.003739 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:13.003803 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.003805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.003858 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.003935 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:13.004219 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.004869 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.006091 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.006650 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.006761 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.006813 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.007042 (+ 229us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.007112 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:41:13.007439 25319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.003016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34405 (local address 127.17.4.131:34219)
0923 14:41:13.003349 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.003363 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.003441 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.003735 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.003739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.003755 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:13.003917 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.003927 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.004907 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.004911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.006204 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.006214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.007018 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.007022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.007121 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.007141 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.007232 (+ 91us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.007321 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":52}
I20260923 14:41:13.007436 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.003196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:34219 (local address 127.17.4.129:34405)
0923 14:41:13.003394 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.003399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.003415 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:41:13.003568 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.003571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.003632 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.003718 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:13.004038 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.004759 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.006336 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.006897 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.007020 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.007063 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.007249 (+ 186us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.007331 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260923 14:41:13.007620 25482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.003090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:36201 (local address 127.17.4.131:38207)
0923 14:41:13.003466 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.003480 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.003577 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.003967 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.003970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.003987 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:13.004101 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.004106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.004989 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.004995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.005952 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.005962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.006767 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.006770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.006870 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.006908 (+ 38us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.007391 (+ 483us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.007460 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":24,"thread_start_us":72,"threads_started":1}
I20260923 14:41:13.008026 25100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1790edf582a643af84942cbea5385828" candidate_uuid: "4307f93a3e574e8d8d0125982fbc77ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360543979ee64322bc4a0a23d5989789" is_pre_election: true
I20260923 14:41:13.008184 25100 raft_consensus.cc:2454] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4307f93a3e574e8d8d0125982fbc77ae in term 0.
I20260923 14:41:13.008384 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1790edf582a643af84942cbea5385828" candidate_uuid: "4307f93a3e574e8d8d0125982fbc77ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124acf59a169494cab4355376e2457ba" is_pre_election: true
I20260923 14:41:13.008570 25312 leader_election.cc:302] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360543979ee64322bc4a0a23d5989789, 4307f93a3e574e8d8d0125982fbc77ae; no voters:
I20260923 14:41:13.008625 25240 raft_consensus.cc:2454] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4307f93a3e574e8d8d0125982fbc77ae in term 0.
I20260923 14:41:13.008831 25462 raft_consensus.cc:2781] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:13.008891 25462 raft_consensus.cc:482] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:13.008935 25462 raft_consensus.cc:3037] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.009903 25462 raft_consensus.cc:504] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.010265 25462 leader_election.cc:288] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [CANDIDATE]: Term 1 election: Requested vote from peers 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405), 124acf59a169494cab4355376e2457ba (127.17.4.130:36201)
I20260923 14:41:13.010569 25100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1790edf582a643af84942cbea5385828" candidate_uuid: "4307f93a3e574e8d8d0125982fbc77ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360543979ee64322bc4a0a23d5989789"
I20260923 14:41:13.010653 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1790edf582a643af84942cbea5385828" candidate_uuid: "4307f93a3e574e8d8d0125982fbc77ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124acf59a169494cab4355376e2457ba"
I20260923 14:41:13.010732 25100 raft_consensus.cc:3037] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.010751 25240 raft_consensus.cc:3037] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.011955 25100 raft_consensus.cc:2454] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4307f93a3e574e8d8d0125982fbc77ae in term 1.
I20260923 14:41:13.011999 25240 raft_consensus.cc:2454] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4307f93a3e574e8d8d0125982fbc77ae in term 1.
I20260923 14:41:13.012287 25313 leader_election.cc:302] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 4307f93a3e574e8d8d0125982fbc77ae; no voters:
I20260923 14:41:13.012455 25462 raft_consensus.cc:2781] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:13.012640 25462 raft_consensus.cc:686] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 LEADER]: Becoming Leader. State: Replica: 4307f93a3e574e8d8d0125982fbc77ae, State: Running, Role: LEADER
I20260923 14:41:13.012910 25462 consensus_queue.cc:237] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.015254 24943 catalog_manager.cc:5495] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131). New cstate: current_term: 1 leader_uuid: "4307f93a3e574e8d8d0125982fbc77ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } health_report { overall_health: HEALTHY } } }
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174471, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.190@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:13.076464 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.061474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.17.4.190:35971)
0923 14:41:13.061642 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.061647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.061779 (+ 132us) server_negotiation.cc:407] Connection header received
0923 14:41:13.061945 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.061948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.061985 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.062074 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:13.062709 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.063233 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.064052 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.064272 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.064374 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.073437 (+ 9063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:13.073440 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:13.073443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:13.073465 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:13.074717 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:13.075201 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:13.075206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:13.075208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:13.075284 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:13.075562 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:13.075565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:13.075567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:13.075729 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:13.075880 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.076168 (+ 288us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.076342 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":79}
I20260923 14:41:13.076464 25490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.061384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:35971 (local address 127.0.0.1:37322)
0923 14:41:13.061693 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.061705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.061844 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.062091 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.062093 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.062505 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:13.062593 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.062599 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.063337 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.063342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.063944 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.063953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.064374 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.064377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.064475 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.071868 (+ 7393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:13.071879 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:13.073279 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:13.074864 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:13.074875 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:13.074881 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:13.075100 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:13.075382 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:13.075385 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:13.075387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:13.075462 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:13.075880 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:13.075887 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:13.076008 (+ 121us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.076125 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.076275 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":93,"threads_started":1}
I20260923 14:41:13.080323 24943 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:37322:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 14:41:13.081002 24943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:13.085615 25202 tablet_service.cc:1467] Processing CreateTablet for tablet 94b10893b81444d3bfc2d7e68c056bd2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ab6b35acd7cf42cab79dd784d43bc2ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:41:13.085690 25360 tablet_service.cc:1467] Processing CreateTablet for tablet 94b10893b81444d3bfc2d7e68c056bd2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ab6b35acd7cf42cab79dd784d43bc2ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:41:13.085640 25080 tablet_service.cc:1467] Processing CreateTablet for tablet 94b10893b81444d3bfc2d7e68c056bd2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ab6b35acd7cf42cab79dd784d43bc2ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 14:41:13.086037 25360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94b10893b81444d3bfc2d7e68c056bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.086037 25202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94b10893b81444d3bfc2d7e68c056bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.086061 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94b10893b81444d3bfc2d7e68c056bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.088449 25455 tablet_bootstrap.cc:492] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: Bootstrap starting.
I20260923 14:41:13.088665 25454 tablet_bootstrap.cc:492] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: Bootstrap starting.
I20260923 14:41:13.088727 25456 tablet_bootstrap.cc:492] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: Bootstrap starting.
I20260923 14:41:13.089356 25455 tablet_bootstrap.cc:654] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.089533 25456 tablet_bootstrap.cc:654] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.089532 25454 tablet_bootstrap.cc:654] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.090956 25455 tablet_bootstrap.cc:492] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: No bootstrap required, opened a new log
I20260923 14:41:13.090956 25454 tablet_bootstrap.cc:492] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: No bootstrap required, opened a new log
I20260923 14:41:13.091046 25455 ts_tablet_manager.cc:1397] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 14:41:13.091048 25454 ts_tablet_manager.cc:1397] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:13.091431 25454 raft_consensus.cc:348] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.091431 25455 raft_consensus.cc:348] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.091547 25454 raft_consensus.cc:374] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.091547 25455 raft_consensus.cc:374] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.091580 25454 raft_consensus.cc:729] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124acf59a169494cab4355376e2457ba, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.091591 25455 raft_consensus.cc:729] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.091709 25454 consensus_queue.cc:260] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.091709 25455 consensus_queue.cc:260] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.091984 25455 ts_tablet_manager.cc:1428] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:13.091984 25454 ts_tablet_manager.cc:1428] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:13.091984 25464 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.092157 25464 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:41:13.092170 25460 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.092278 25460 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:41:13.092433 25456 tablet_bootstrap.cc:492] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: No bootstrap required, opened a new log
I20260923 14:41:13.092541 25456 ts_tablet_manager.cc:1397] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260923 14:41:13.092999 25456 raft_consensus.cc:348] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.093142 25456 raft_consensus.cc:374] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.093175 25456 raft_consensus.cc:729] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4307f93a3e574e8d8d0125982fbc77ae, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.093284 25456 consensus_queue.cc:260] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.093532 25483 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.093614 25456 ts_tablet_manager.cc:1428] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:41:13.093681 25483 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:41:13.118090 25460 raft_consensus.cc:482] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:13.118202 25460 raft_consensus.cc:504] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.119252 25460 leader_election.cc:288] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 124acf59a169494cab4355376e2457ba (127.17.4.130:36201), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:13.123298 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.119474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45857 (local address 127.17.4.129:55305)
0923 14:41:13.119954 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.119965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.120046 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.120300 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.120303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.120318 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:13.120471 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.120477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.121235 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.121238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.122167 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.122176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.122819 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.122826 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.122937 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.122991 (+ 54us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.123047 (+ 56us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.123138 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":86,"thread_start_us":176,"threads_started":1}
I20260923 14:41:13.123301 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.119608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55305 (local address 127.17.4.131:45857)
0923 14:41:13.119752 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.119757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.120036 (+ 279us) server_negotiation.cc:407] Connection header received
0923 14:41:13.120152 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.120154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.120193 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.120247 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:13.120584 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.121103 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.122301 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.122706 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.122796 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.122871 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.123101 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.123185 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 14:41:13.123366 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.119507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:36425 (local address 127.17.4.130:36201)
0923 14:41:13.119646 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.119653 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.119943 (+ 290us) server_negotiation.cc:407] Connection header received
0923 14:41:13.120156 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.120159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.120212 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.120300 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:13.120640 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.121110 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.122376 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.122768 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.122880 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.122934 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.123175 (+ 241us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.123248 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:41:13.123392 25494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.119431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:36201 (local address 127.17.4.129:36425)
0923 14:41:13.119854 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.119866 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.119993 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.120344 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.120348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.120364 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:13.120494 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.120499 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.121231 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.121234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.122178 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.122188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.122891 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.122895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.123061 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.123090 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.123160 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.123219 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":90,"thread_start_us":181,"threads_started":1}
I20260923 14:41:13.123917 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94b10893b81444d3bfc2d7e68c056bd2" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae" is_pre_election: true
I20260923 14:41:13.123932 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94b10893b81444d3bfc2d7e68c056bd2" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124acf59a169494cab4355376e2457ba" is_pre_election: true
I20260923 14:41:13.124048 25380 raft_consensus.cc:2454] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 0.
I20260923 14:41:13.124085 25240 raft_consensus.cc:2454] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 0.
I20260923 14:41:13.124377 25031 leader_election.cc:302] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 360543979ee64322bc4a0a23d5989789, 4307f93a3e574e8d8d0125982fbc77ae; no voters:
I20260923 14:41:13.124647 25460 raft_consensus.cc:2781] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:13.124704 25460 raft_consensus.cc:482] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:13.124754 25460 raft_consensus.cc:3037] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.125758 25460 raft_consensus.cc:504] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.126072 25460 leader_election.cc:288] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 election: Requested vote from peers 124acf59a169494cab4355376e2457ba (127.17.4.130:36201), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:13.126305 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94b10893b81444d3bfc2d7e68c056bd2" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124acf59a169494cab4355376e2457ba"
I20260923 14:41:13.126436 25240 raft_consensus.cc:3037] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.126411 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94b10893b81444d3bfc2d7e68c056bd2" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae"
I20260923 14:41:13.126540 25380 raft_consensus.cc:3037] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.127305 25240 raft_consensus.cc:2454] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 1.
I20260923 14:41:13.127570 25380 raft_consensus.cc:2454] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 1.
I20260923 14:41:13.127568 25033 leader_election.cc:302] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 360543979ee64322bc4a0a23d5989789; no voters:
I20260923 14:41:13.127743 25460 raft_consensus.cc:2781] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:13.127954 25460 raft_consensus.cc:686] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [term 1 LEADER]: Becoming Leader. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Running, Role: LEADER
I20260923 14:41:13.128183 25460 consensus_queue.cc:237] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.129534 25496 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: TxnStatusTablet state changed. Reason: New leader 360543979ee64322bc4a0a23d5989789. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.129660 25496 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:41:13.129894 25498 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 14:41:13.130048 25498 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 14:41:13.130155 24942 catalog_manager.cc:5495] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360543979ee64322bc4a0a23d5989789 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260923 14:41:13.144459 25490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.140895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34405 (local address 127.0.0.1:36354)
0923 14:41:13.141058 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.141074 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.141217 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.141521 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.141524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.141533 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:41:13.141636 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.141642 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.142344 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.142349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.142959 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.142967 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.143401 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.143404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.143501 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.143541 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.144194 (+ 653us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.144209 (+ 15us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.144273 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.144351 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 14:41:13.144449 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.140971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36354 (local address 127.17.4.129:34405)
0923 14:41:13.141070 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.141075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.141144 (+ 69us) server_negotiation.cc:407] Connection header received
0923 14:41:13.141347 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.141351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.141404 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.141503 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.141739 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.142233 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.143089 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.143292 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.143390 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.143686 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.144098 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.144219 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.144282 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.144330 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:41:13.147116 25380 raft_consensus.cc:1261] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Refusing update from remote peer 360543979ee64322bc4a0a23d5989789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.147276 25240 raft_consensus.cc:1261] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Refusing update from remote peer 360543979ee64322bc4a0a23d5989789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.147557 25496 consensus_queue.cc:1035] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.147804 25460 consensus_queue.cc:1035] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.149344 25464 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: TxnStatusTablet state changed. Reason: New leader 360543979ee64322bc4a0a23d5989789. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.149466 25464 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:41:13.150310 25483 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: TxnStatusTablet state changed. Reason: New leader 360543979ee64322bc4a0a23d5989789. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.150416 25483 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:41:13.151036 25460 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.151141 25460 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:41:13.151252 25460 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.151337 25460 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 360543979ee64322bc4a0a23d5989789: This TxnStatusTablet replica's current role is: LEADER
I20260923 14:41:13.152208 25464 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.152316 25464 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 124acf59a169494cab4355376e2457ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 14:41:13.152390 25467 mvcc.cc:205] Tried to move back new op lower bound from 7332554642006323200 to 7332554641935077376. Current Snapshot: MvccSnapshot[applied={T|T < 7332554642006323200 or (T in {7332554642006323200})}]
I20260923 14:41:13.152563 25468 mvcc.cc:205] Tried to move back new op lower bound from 7332554642006323200 to 7332554641935077376. Current Snapshot: MvccSnapshot[applied={T|T < 7332554642006323200 or (T in {7332554642006323200})}]
I20260923 14:41:13.154295 25483 tablet_replica.cc:439] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } } }
I20260923 14:41:13.154392 25483 tablet_replica.cc:442] T 94b10893b81444d3bfc2d7e68c056bd2 P 4307f93a3e574e8d8d0125982fbc77ae: This TxnStatusTablet replica's current role is: FOLLOWER
W20260923 14:41:13.155799 25147 tablet.cc:2369] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:13.163559 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.159272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.17.4.131:45857)
0923 14:41:13.159369 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.159373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.159500 (+ 127us) server_negotiation.cc:407] Connection header received
0923 14:41:13.159652 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.159655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.159708 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.159821 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.160087 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.160889 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.162033 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.162360 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.162462 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.162726 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.163191 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.163298 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.163376 (+ 78us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.163427 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 14:41:13.174608 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.170890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:33875 (local address 127.17.4.129:34405)
0923 14:41:13.171004 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.171008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.171021 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:13.171117 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.171120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.171178 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.171248 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.171527 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.172245 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.173436 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.173772 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.173865 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.174183 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.174254 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.174320 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.174429 (+ 109us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.174477 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:41:13.174654 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.170650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34405 (local address 127.17.4.131:33875)
0923 14:41:13.170911 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.170925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.171021 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.171284 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.171287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.171294 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:41:13.171412 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.171418 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.172353 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.172356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.173318 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.173329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.173901 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.173905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.174003 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.174049 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.174338 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.174344 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.174408 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.174482 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":85,"threads_started":1}
I20260923 14:41:13.181483 25100 raft_consensus.cc:1261] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Refusing update from remote peer 4307f93a3e574e8d8d0125982fbc77ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.181815 25240 raft_consensus.cc:1261] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Refusing update from remote peer 4307f93a3e574e8d8d0125982fbc77ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.181912 25462 consensus_queue.cc:1035] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.182181 25483 consensus_queue.cc:1035] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.204049 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.200413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45857 (local address 127.17.4.129:55551)
0923 14:41:13.200711 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.200724 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.200862 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.201114 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.201117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.201125 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:41:13.201243 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.201249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.202211 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.202214 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.202847 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.202857 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.203319 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.203322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.203420 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.203459 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.203744 (+ 285us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.203753 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.203846 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.203920 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
I20260923 14:41:13.204033 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.200459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55551 (local address 127.17.4.131:45857)
0923 14:41:13.200578 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.200583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.200825 (+ 242us) server_negotiation.cc:407] Connection header received
0923 14:41:13.200954 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.200958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.201011 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.201080 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.201431 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.202056 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.202992 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.203212 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.203317 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.203594 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.203665 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.203741 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.203854 (+ 113us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.203901 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:41:13.225006 24942 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:13.225173 24942 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:13.227209 24942 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Sending DeleteTablet for 3 replicas of tablet 1790edf582a643af84942cbea5385828
I20260923 14:41:13.227885 25202 tablet_service.cc:1514] Processing DeleteTablet for tablet 1790edf582a643af84942cbea5385828 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58660
I20260923 14:41:13.227891 25080 tablet_service.cc:1514] Processing DeleteTablet for tablet 1790edf582a643af84942cbea5385828 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:36346
I20260923 14:41:13.228075 25477 tablet_replica.cc:330] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: stopping tablet replica
I20260923 14:41:13.228192 25477 raft_consensus.cc:2229] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:13.228338 25477 raft_consensus.cc:2258] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.228539 25476 tablet_replica.cc:330] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: stopping tablet replica
I20260923 14:41:13.228660 25476 raft_consensus.cc:2229] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:13.228798 25476 raft_consensus.cc:2258] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.229398 25360 tablet_service.cc:1514] Processing DeleteTablet for tablet 1790edf582a643af84942cbea5385828 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:47636
I20260923 14:41:13.229622 25478 tablet_replica.cc:330] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: stopping tablet replica
I20260923 14:41:13.229679 25476 ts_tablet_manager.cc:1905] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.229748 25478 raft_consensus.cc:2229] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:13.229946 25477 ts_tablet_manager.cc:1905] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.230027 25478 raft_consensus.cc:2258] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.232494 25478 ts_tablet_manager.cc:1905] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.232592 25476 ts_tablet_manager.cc:1918] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:41:13.232653 25476 log.cc:1196] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/1790edf582a643af84942cbea5385828
I20260923 14:41:13.232910 25476 ts_tablet_manager.cc:1939] T 1790edf582a643af84942cbea5385828 P 360543979ee64322bc4a0a23d5989789: Deleting consensus metadata
I20260923 14:41:13.233559 24928 catalog_manager.cc:4841] TS 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405): tablet 1790edf582a643af84942cbea5385828 (table test-table [id=2cdf0d384bb34f8f90e15a65c34d448e]) successfully deleted
I20260923 14:41:13.234937 25478 ts_tablet_manager.cc:1918] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:41:13.235030 25478 log.cc:1196] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/1790edf582a643af84942cbea5385828
I20260923 14:41:13.235276 25478 ts_tablet_manager.cc:1939] T 1790edf582a643af84942cbea5385828 P 4307f93a3e574e8d8d0125982fbc77ae: Deleting consensus metadata
I20260923 14:41:13.235912 24927 catalog_manager.cc:4841] TS 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857): tablet 1790edf582a643af84942cbea5385828 (table test-table [id=2cdf0d384bb34f8f90e15a65c34d448e]) successfully deleted
I20260923 14:41:13.236871 25477 ts_tablet_manager.cc:1918] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:41:13.236963 25477 log.cc:1196] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/1790edf582a643af84942cbea5385828
I20260923 14:41:13.237236 25477 ts_tablet_manager.cc:1939] T 1790edf582a643af84942cbea5385828 P 124acf59a169494cab4355376e2457ba: Deleting consensus metadata
I20260923 14:41:13.240015 24929 catalog_manager.cc:4841] TS 124acf59a169494cab4355376e2457ba (127.17.4.130:36201): tablet 1790edf582a643af84942cbea5385828 (table test-table [id=2cdf0d384bb34f8f90e15a65c34d448e]) successfully deleted
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[24898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
W20260923 14:41:13.270996 24992 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:13.263231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37326 (local address 127.17.4.190:35971)
0923 14:41:13.263352 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.263357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.263631 (+ 274us) server_negotiation.cc:407] Connection header received
0923 14:41:13.263783 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.263787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.263853 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.263936 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:13.264786 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.265641 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.266812 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.267162 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.267268 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.270875 (+ 3607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37326: BlockingRecv error: recv got EOF from 127.0.0.1:37326 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[24898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM
I20260923 14:41:13.282752 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.272926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37330 (local address 127.17.4.190:35971)
0923 14:41:13.273024 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.273028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.273232 (+ 204us) server_negotiation.cc:407] Connection header received
0923 14:41:13.273316 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.273319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.273363 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.273448 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:13.274146 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.274896 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.276033 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.276370 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.276480 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.279236 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:13.279240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:13.279243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:13.279268 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:13.281010 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:13.281494 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:13.281498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:13.281500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:13.281584 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:13.281889 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:13.281892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:13.281894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:13.282095 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:13.282222 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.282494 (+ 272us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.282602 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 14:41:13.285561 24942 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37330:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:13.286015 24942 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:13.291229 25080 tablet_service.cc:1467] Processing CreateTablet for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa (DEFAULT_TABLE table=test-table [id=a698b8b9a6014e6ca08173bc8137bf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:13.291518 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.291504 25360 tablet_service.cc:1467] Processing CreateTablet for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa (DEFAULT_TABLE table=test-table [id=a698b8b9a6014e6ca08173bc8137bf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:13.291807 25360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.293948 25455 tablet_bootstrap.cc:492] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Bootstrap starting.
I20260923 14:41:13.295221 25455 tablet_bootstrap.cc:654] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.295835 25456 tablet_bootstrap.cc:492] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Bootstrap starting.
I20260923 14:41:13.296691 25456 tablet_bootstrap.cc:654] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.297400 25202 tablet_service.cc:1467] Processing CreateTablet for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa (DEFAULT_TABLE table=test-table [id=a698b8b9a6014e6ca08173bc8137bf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:13.297710 25202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.300042 25454 tablet_bootstrap.cc:492] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Bootstrap starting.
I20260923 14:41:13.300796 25455 tablet_bootstrap.cc:492] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: No bootstrap required, opened a new log
I20260923 14:41:13.300838 25454 tablet_bootstrap.cc:654] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.300880 25455 ts_tablet_manager.cc:1397] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260923 14:41:13.301303 25455 raft_consensus.cc:348] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.301406 25455 raft_consensus.cc:374] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.301436 25455 raft_consensus.cc:729] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.301573 25455 consensus_queue.cc:260] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.302088 25455 ts_tablet_manager.cc:1428] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:13.302230 25454 tablet_bootstrap.cc:492] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: No bootstrap required, opened a new log
I20260923 14:41:13.302325 25454 ts_tablet_manager.cc:1397] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:13.302688 25454 raft_consensus.cc:348] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.302790 25454 raft_consensus.cc:374] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.302822 25454 raft_consensus.cc:729] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124acf59a169494cab4355376e2457ba, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.302932 25454 consensus_queue.cc:260] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.303036 25456 tablet_bootstrap.cc:492] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: No bootstrap required, opened a new log
I20260923 14:41:13.303121 25456 ts_tablet_manager.cc:1397] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260923 14:41:13.303215 25454 ts_tablet_manager.cc:1428] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:13.303592 25456 raft_consensus.cc:348] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.303697 25456 raft_consensus.cc:374] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.303730 25456 raft_consensus.cc:729] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4307f93a3e574e8d8d0125982fbc77ae, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.303884 25456 consensus_queue.cc:260] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.304153 25456 ts_tablet_manager.cc:1428] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:41:13.304836 25460 raft_consensus.cc:482] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:13.304915 25460 raft_consensus.cc:504] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.305260 25460 leader_election.cc:288] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 124acf59a169494cab4355376e2457ba (127.17.4.130:36201), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:13.305835 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751ef9a2c0794c2fa2bf5fdd1fa248aa" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124acf59a169494cab4355376e2457ba" is_pre_election: true
I20260923 14:41:13.305958 25240 raft_consensus.cc:2454] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 0.
I20260923 14:41:13.306187 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751ef9a2c0794c2fa2bf5fdd1fa248aa" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae" is_pre_election: true
I20260923 14:41:13.306300 25380 raft_consensus.cc:2454] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 0.
I20260923 14:41:13.306589 25033 leader_election.cc:302] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 360543979ee64322bc4a0a23d5989789; no voters:
I20260923 14:41:13.307108 25460 raft_consensus.cc:2781] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:13.307173 25460 raft_consensus.cc:482] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:13.307220 25460 raft_consensus.cc:3037] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.308193 25460 raft_consensus.cc:504] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.308533 25460 leader_election.cc:288] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 election: Requested vote from peers 124acf59a169494cab4355376e2457ba (127.17.4.130:36201), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:13.308940 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751ef9a2c0794c2fa2bf5fdd1fa248aa" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae"
I20260923 14:41:13.309049 25380 raft_consensus.cc:3037] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.309190 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "751ef9a2c0794c2fa2bf5fdd1fa248aa" candidate_uuid: "360543979ee64322bc4a0a23d5989789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "124acf59a169494cab4355376e2457ba"
I20260923 14:41:13.309286 25240 raft_consensus.cc:3037] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.310123 25380 raft_consensus.cc:2454] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 1.
I20260923 14:41:13.310302 25240 raft_consensus.cc:2454] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360543979ee64322bc4a0a23d5989789 in term 1.
I20260923 14:41:13.310600 25033 leader_election.cc:302] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 360543979ee64322bc4a0a23d5989789; no voters:
I20260923 14:41:13.311422 25460 raft_consensus.cc:2781] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:13.311511 25460 raft_consensus.cc:686] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 1 LEADER]: Becoming Leader. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Running, Role: LEADER
I20260923 14:41:13.311626 25460 consensus_queue.cc:237] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.313371 24941 catalog_manager.cc:5495] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 reported cstate change: term changed from 0 to 1, leader changed from <none> to 360543979ee64322bc4a0a23d5989789 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "360543979ee64322bc4a0a23d5989789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260923 14:41:13.326324 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.322884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36362 (local address 127.17.4.129:34405)
0923 14:41:13.323215 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.323219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.323229 (+ 10us) server_negotiation.cc:407] Connection header received
0923 14:41:13.323262 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.323264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.323300 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.323384 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.323625 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.324225 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.325237 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.325462 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.325575 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.325855 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.325944 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.326048 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.326145 (+ 97us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.326197 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266}
I20260923 14:41:13.328258 25240 raft_consensus.cc:1261] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Refusing update from remote peer 360543979ee64322bc4a0a23d5989789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.328254 25380 raft_consensus.cc:1261] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Refusing update from remote peer 360543979ee64322bc4a0a23d5989789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.328634 25496 consensus_queue.cc:1035] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.328748 25460 consensus_queue.cc:1035] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.340785 24942 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:13.340924 24942 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:13.342792 24942 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Sending DeleteTablet for 3 replicas of tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa
I20260923 14:41:13.343255 25080 tablet_service.cc:1514] Processing DeleteTablet for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:36346
I20260923 14:41:13.343434 25202 tablet_service.cc:1514] Processing DeleteTablet for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58660
I20260923 14:41:13.343464 25360 tablet_service.cc:1514] Processing DeleteTablet for tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:47636
I20260923 14:41:13.343614 25476 tablet_replica.cc:330] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: stopping tablet replica
I20260923 14:41:13.343719 25476 raft_consensus.cc:2229] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:13.343873 25477 tablet_replica.cc:330] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: stopping tablet replica
I20260923 14:41:13.343943 25478 tablet_replica.cc:330] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: stopping tablet replica
I20260923 14:41:13.343986 25477 raft_consensus.cc:2229] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:13.344045 25478 raft_consensus.cc:2229] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:13.344105 25477 raft_consensus.cc:2258] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.344151 25478 raft_consensus.cc:2258] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.344560 24942 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37330:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 14:41:13.344688 25476 raft_consensus.cc:2258] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 14:41:13.344974 24942 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:13.345672 25477 ts_tablet_manager.cc:1905] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.347695 25477 ts_tablet_manager.cc:1918] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:13.347747 25477 log.cc:1196] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/751ef9a2c0794c2fa2bf5fdd1fa248aa
I20260923 14:41:13.347998 25477 ts_tablet_manager.cc:1939] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 124acf59a169494cab4355376e2457ba: Deleting consensus metadata
I20260923 14:41:13.348927 25476 ts_tablet_manager.cc:1905] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.351667 25476 ts_tablet_manager.cc:1918] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:13.351668 25360 tablet_service.cc:1467] Processing CreateTablet for tablet 6ec334ef9bea4f839435c2f8e2635f9a (DEFAULT_TABLE table=test-table [id=61a239e26f384eaf94da0d31c9b9fa02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:13.351967 25360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ec334ef9bea4f839435c2f8e2635f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.352226 25080 tablet_service.cc:1467] Processing CreateTablet for tablet 6ec334ef9bea4f839435c2f8e2635f9a (DEFAULT_TABLE table=test-table [id=61a239e26f384eaf94da0d31c9b9fa02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:13.353010 25080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ec334ef9bea4f839435c2f8e2635f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.354589 24929 catalog_manager.cc:4841] TS 124acf59a169494cab4355376e2457ba (127.17.4.130:36201): tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa (table test-table [id=a698b8b9a6014e6ca08173bc8137bf72]) successfully deleted
I20260923 14:41:13.355209 25456 tablet_bootstrap.cc:492] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Bootstrap starting.
I20260923 14:41:13.356218 25456 tablet_bootstrap.cc:654] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.356750 25455 tablet_bootstrap.cc:492] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Bootstrap starting.
I20260923 14:41:13.357532 25455 tablet_bootstrap.cc:654] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.358271 25202 tablet_service.cc:1467] Processing CreateTablet for tablet 6ec334ef9bea4f839435c2f8e2635f9a (DEFAULT_TABLE table=test-table [id=61a239e26f384eaf94da0d31c9b9fa02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:13.358469 25202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ec334ef9bea4f839435c2f8e2635f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:13.360695 25454 tablet_bootstrap.cc:492] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Bootstrap starting.
I20260923 14:41:13.361258 25454 tablet_bootstrap.cc:654] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:13.362207 25454 tablet_bootstrap.cc:492] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: No bootstrap required, opened a new log
I20260923 14:41:13.362313 25454 ts_tablet_manager.cc:1397] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:13.362732 25454 raft_consensus.cc:348] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.362834 25454 raft_consensus.cc:374] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.362872 25454 raft_consensus.cc:729] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 124acf59a169494cab4355376e2457ba, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.362984 25454 consensus_queue.cc:260] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.363220 25454 ts_tablet_manager.cc:1428] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 14:41:13.363679 25456 tablet_bootstrap.cc:492] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: No bootstrap required, opened a new log
I20260923 14:41:13.363754 25456 ts_tablet_manager.cc:1397] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260923 14:41:13.364117 25456 raft_consensus.cc:348] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.364223 25456 raft_consensus.cc:374] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.364261 25456 raft_consensus.cc:729] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4307f93a3e574e8d8d0125982fbc77ae, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.364362 25456 consensus_queue.cc:260] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.364621 25456 ts_tablet_manager.cc:1428] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 14:41:13.366389 25476 log.cc:1196] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/751ef9a2c0794c2fa2bf5fdd1fa248aa
I20260923 14:41:13.367090 25476 ts_tablet_manager.cc:1939] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 360543979ee64322bc4a0a23d5989789: Deleting consensus metadata
I20260923 14:41:13.367904 24928 catalog_manager.cc:4841] TS 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405): tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa (table test-table [id=a698b8b9a6014e6ca08173bc8137bf72]) successfully deleted
I20260923 14:41:13.368072 25478 ts_tablet_manager.cc:1905] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.369665 25478 ts_tablet_manager.cc:1918] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:13.369750 25478 log.cc:1196] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/751ef9a2c0794c2fa2bf5fdd1fa248aa
I20260923 14:41:13.369994 25478 ts_tablet_manager.cc:1939] T 751ef9a2c0794c2fa2bf5fdd1fa248aa P 4307f93a3e574e8d8d0125982fbc77ae: Deleting consensus metadata
I20260923 14:41:13.370591 24927 catalog_manager.cc:4841] TS 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857): tablet 751ef9a2c0794c2fa2bf5fdd1fa248aa (table test-table [id=a698b8b9a6014e6ca08173bc8137bf72]) successfully deleted
I20260923 14:41:13.371505 25455 tablet_bootstrap.cc:492] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: No bootstrap required, opened a new log
I20260923 14:41:13.371615 25455 ts_tablet_manager.cc:1397] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20260923 14:41:13.372016 25455 raft_consensus.cc:348] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.372140 25455 raft_consensus.cc:374] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:13.372172 25455 raft_consensus.cc:729] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360543979ee64322bc4a0a23d5989789, State: Initialized, Role: FOLLOWER
I20260923 14:41:13.372303 25455 consensus_queue.cc:260] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.372550 25455 ts_tablet_manager.cc:1428] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 14:41:13.372963 25464 raft_consensus.cc:482] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:13.373041 25464 raft_consensus.cc:504] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.373416 25464 leader_election.cc:288] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:13.373757 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ec334ef9bea4f839435c2f8e2635f9a" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae" is_pre_election: true
I20260923 14:41:13.373790 25100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ec334ef9bea4f839435c2f8e2635f9a" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360543979ee64322bc4a0a23d5989789" is_pre_election: true
I20260923 14:41:13.373867 25380 raft_consensus.cc:2454] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 0.
I20260923 14:41:13.373896 25100 raft_consensus.cc:2454] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 0.
I20260923 14:41:13.374157 25171 leader_election.cc:302] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 4307f93a3e574e8d8d0125982fbc77ae; no voters:
I20260923 14:41:13.374328 25464 raft_consensus.cc:2781] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:13.374370 25464 raft_consensus.cc:482] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:13.374415 25464 raft_consensus.cc:3037] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.375461 25464 raft_consensus.cc:504] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.375842 25464 leader_election.cc:288] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 election: Requested vote from peers 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405), 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857)
I20260923 14:41:13.376147 25100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ec334ef9bea4f839435c2f8e2635f9a" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "360543979ee64322bc4a0a23d5989789"
I20260923 14:41:13.376273 25100 raft_consensus.cc:3037] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.377020 25100 raft_consensus.cc:2454] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 1.
I20260923 14:41:13.377310 25172 leader_election.cc:302] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 124acf59a169494cab4355376e2457ba, 360543979ee64322bc4a0a23d5989789; no voters:
I20260923 14:41:13.380024 25464 raft_consensus.cc:2781] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:13.380129 25464 raft_consensus.cc:686] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 1 LEADER]: Becoming Leader. State: Replica: 124acf59a169494cab4355376e2457ba, State: Running, Role: LEADER
I20260923 14:41:13.380199 25380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ec334ef9bea4f839435c2f8e2635f9a" candidate_uuid: "124acf59a169494cab4355376e2457ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4307f93a3e574e8d8d0125982fbc77ae"
I20260923 14:41:13.380244 25464 consensus_queue.cc:237] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } }
I20260923 14:41:13.380301 25380 raft_consensus.cc:3037] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:13.381319 25380 raft_consensus.cc:2454] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 124acf59a169494cab4355376e2457ba in term 1.
I20260923 14:41:13.382124 24942 catalog_manager.cc:5495] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 124acf59a169494cab4355376e2457ba (127.17.4.130). New cstate: current_term: 1 leader_uuid: "124acf59a169494cab4355376e2457ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "124acf59a169494cab4355376e2457ba" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 36201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260923 14:41:13.404037 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.399947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40258 (local address 127.17.4.130:36201)
0923 14:41:13.400283 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.400287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.400296 (+ 9us) server_negotiation.cc:407] Connection header received
0923 14:41:13.400356 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.400359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.400403 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.400479 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.400738 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.401497 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.402720 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.403029 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.403113 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.403398 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.403468 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.403519 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.403881 (+ 362us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.403928 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278}
I20260923 14:41:13.414170 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.410067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:44495 (local address 127.17.4.129:34405)
0923 14:41:13.410180 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.410184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.410435 (+ 251us) server_negotiation.cc:407] Connection header received
0923 14:41:13.410556 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.410559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.410614 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.410681 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.410902 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.411650 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.413005 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.413328 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.413448 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.413747 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.413824 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.413898 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.414017 (+ 119us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.414062 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 14:41:13.414188 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.409976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34405 (local address 127.17.4.130:44495)
0923 14:41:13.410327 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.410340 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.410453 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.410706 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.410709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.410716 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:41:13.410804 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.410809 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.411806 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.411809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.412874 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.412885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.413448 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.413451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.413532 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.413575 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.413912 (+ 337us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.413919 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.413979 (+ 60us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.414059 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":84,"threads_started":1}
I20260923 14:41:13.421736 25100 raft_consensus.cc:1261] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Refusing update from remote peer 124acf59a169494cab4355376e2457ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.421787 25380 raft_consensus.cc:1261] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Refusing update from remote peer 124acf59a169494cab4355376e2457ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:13.422127 25464 consensus_queue.cc:1035] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "4307f93a3e574e8d8d0125982fbc77ae" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.422367 25464 consensus_queue.cc:1035] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "360543979ee64322bc4a0a23d5989789" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:13.444420 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.441124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:47741 (local address 127.17.4.130:36201)
0923 14:41:13.441219 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:13.441225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:13.441244 (+ 19us) server_negotiation.cc:407] Connection header received
0923 14:41:13.441375 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:13.441378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:13.441429 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:13.441505 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:13.441751 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.442504 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.443411 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.443741 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.443869 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.444050 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.444120 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.444183 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:13.444257 (+ 74us) server_negotiation.cc:299] Negotiation successful
0923 14:41:13.444301 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260923 14:41:13.444445 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:13.441080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:36201 (local address 127.17.4.129:47741)
0923 14:41:13.441196 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:13.441212 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:13.441289 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:13.441525 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:13.441528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:13.441536 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 14:41:13.441631 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.441637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.442615 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.442618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.443304 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:13.443313 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:13.443867 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:13.443870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:13.443931 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:13.443955 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 14:41:13.444194 (+ 239us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 14:41:13.444198 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:41:13.444238 (+ 40us) client_negotiation.cc:240] Negotiation successful
0923 14:41:13.444326 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260923 14:41:13.462266 24942 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:13.462386 24942 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:13.464139 24942 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f3d51624a264340b86475881d2f98f6: Sending DeleteTablet for 3 replicas of tablet 6ec334ef9bea4f839435c2f8e2635f9a
I20260923 14:41:13.464659 25080 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ec334ef9bea4f839435c2f8e2635f9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:36346
I20260923 14:41:13.464700 25202 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ec334ef9bea4f839435c2f8e2635f9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:58660
I20260923 14:41:13.464876 25476 tablet_replica.cc:330] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: stopping tablet replica
I20260923 14:41:13.464887 25360 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ec334ef9bea4f839435c2f8e2635f9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:13 UTC) from {username='oryx', principal='oryx/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:47636
I20260923 14:41:13.464960 25476 raft_consensus.cc:2229] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:13.465052 25477 tablet_replica.cc:330] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: stopping tablet replica
I20260923 14:41:13.465073 25478 tablet_replica.cc:330] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: stopping tablet replica
I20260923 14:41:13.465068 25476 raft_consensus.cc:2258] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.465149 25477 raft_consensus.cc:2229] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:13.465179 25478 raft_consensus.cc:2229] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:13.465273 25478 raft_consensus.cc:2258] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.465319 25477 raft_consensus.cc:2258] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:13.465698 25476 ts_tablet_manager.cc:1905] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.465857 25478 ts_tablet_manager.cc:1905] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.466332 25477 ts_tablet_manager.cc:1905] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:13.468066 25478 ts_tablet_manager.cc:1918] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:41:13.468066 25476 ts_tablet_manager.cc:1918] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:41:13.468135 25476 log.cc:1196] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/6ec334ef9bea4f839435c2f8e2635f9a
I20260923 14:41:13.468134 25478 log.cc:1196] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/6ec334ef9bea4f839435c2f8e2635f9a
I20260923 14:41:13.468390 25476 ts_tablet_manager.cc:1939] T 6ec334ef9bea4f839435c2f8e2635f9a P 360543979ee64322bc4a0a23d5989789: Deleting consensus metadata
I20260923 14:41:13.468390 25478 ts_tablet_manager.cc:1939] T 6ec334ef9bea4f839435c2f8e2635f9a P 4307f93a3e574e8d8d0125982fbc77ae: Deleting consensus metadata
I20260923 14:41:13.468679 25477 ts_tablet_manager.cc:1918] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 14:41:13.468782 25477 log.cc:1196] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/6ec334ef9bea4f839435c2f8e2635f9a
I20260923 14:41:13.469027 25477 ts_tablet_manager.cc:1939] T 6ec334ef9bea4f839435c2f8e2635f9a P 124acf59a169494cab4355376e2457ba: Deleting consensus metadata
I20260923 14:41:13.469274 24928 catalog_manager.cc:4841] TS 360543979ee64322bc4a0a23d5989789 (127.17.4.129:34405): tablet 6ec334ef9bea4f839435c2f8e2635f9a (table test-table [id=61a239e26f384eaf94da0d31c9b9fa02]) successfully deleted
I20260923 14:41:13.469274 24927 catalog_manager.cc:4841] TS 4307f93a3e574e8d8d0125982fbc77ae (127.17.4.131:45857): tablet 6ec334ef9bea4f839435c2f8e2635f9a (table test-table [id=61a239e26f384eaf94da0d31c9b9fa02]) successfully deleted
I20260923 14:41:13.469580 24929 catalog_manager.cc:4841] TS 124acf59a169494cab4355376e2457ba (127.17.4.130:36201): tablet 6ec334ef9bea4f839435c2f8e2635f9a (table test-table [id=61a239e26f384eaf94da0d31c9b9fa02]) successfully deleted
I20260923 14:41:13.470269 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25015
I20260923 14:41:13.477382 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25155
I20260923 14:41:13.483840 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25295
I20260923 14:41:13.489778 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 24911
2026-09-23T14:41:13Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2904 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[25546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[25546](info): set up 2 sockets
Sep 23 14:41:13 dist-test-slave-54kg krb5kdc[25546](info): commencing operation
krb5kdc: starting...
W20260923 14:41:14.505196 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.994s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:14 dist-test-slave-54kg krb5kdc[25546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:41:14.618713 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46325
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:14.723858 25559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:14.724120 25559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:14.724223 25559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:14.727933 25559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:14.728008 25559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:14.728042 25559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:14.728093 25559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:14.728129 25559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:14.733340 25559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:14.734274 25559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:14.735195 25559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:14.742844 25564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:14.742839 25567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:14.742971 25559 server_base.cc:1034] running on GCE node
W20260923 14:41:14.742883 25565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:14.743614 25559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:14.744582 25559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:14.745757 25559 hybrid_clock.cc:648] HybridClock initialized: now 1790174474745747 us; error 50 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-23T14:41:14Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1265 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:14 dist-test-slave-54kg krb5kdc[25572](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:14 dist-test-slave-54kg krb5kdc[25572](info): set up 2 sockets
Sep 23 14:41:14 dist-test-slave-54kg krb5kdc[25572](info): commencing operation
krb5kdc: starting...
W20260923 14:41:15.765561 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.988s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:15 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:41:15.882305 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:42039
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:42039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:15.984730 25585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:15.984947 25585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:15.985041 25585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:15.988783 25585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:15.988830 25585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:15.988847 25585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:15.988909 25585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:15.988936 25585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:15.993801 25585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:42039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:42039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:15.994712 25585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:15.995653 25585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:16.003471 25585 server_base.cc:1034] running on GCE node
W20260923 14:41:16.003360 25593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.003362 25591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.003422 25590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:16.004244 25585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:16.005182 25585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:16.006336 25585 hybrid_clock.cc:648] HybridClock initialized: now 1790174476006310 us; error 39 us; skew 500 ppm
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:16.014899 25585 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:41:16.015853 25585 webserver.cc:460] Webserver started at http://127.17.4.190:35819/ using document root <none> and password file <none>
I20260923 14:41:16.016393 25585 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:16.016448 25585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:16.016686 25585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:16.018618 25585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "06f0b80989394294acb48a546ccf602c"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "969d3407c214281fa69946239f1edb05"
server_key_iv: "887cdfd253ca61509d0e65fb1676c2b4"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.019172 25585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "06f0b80989394294acb48a546ccf602c"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "969d3407c214281fa69946239f1edb05"
server_key_iv: "887cdfd253ca61509d0e65fb1676c2b4"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.022795 25585 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:41:16.025028 25600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.026188 25585 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:16.026326 25585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "06f0b80989394294acb48a546ccf602c"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "969d3407c214281fa69946239f1edb05"
server_key_iv: "887cdfd253ca61509d0e65fb1676c2b4"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.026419 25585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:16.045975 25585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:16.048614 25585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:16.048794 25585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:16.055336 25585 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:42039
I20260923 14:41:16.055361 25652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:42039 every 8 connection(s)
I20260923 14:41:16.056278 25585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:16.057331 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25585
I20260923 14:41:16.057490 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:16.057798 17426 external_mini_cluster.cc:1428] Setting key bcb71e2de83e02358cb36c09b534f12f
I20260923 14:41:16.059428 25653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:16.064546 25653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Bootstrap starting.
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:16.066983 25653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:16.067934 25653 log.cc:824] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:16.070067 25653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: No bootstrap required, opened a new log
I20260923 14:41:16.072993 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.059197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.17.4.190:42039)
0923 14:41:16.059634 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:16.059648 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:16.059682 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:41:16.060333 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:16.060350 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:16.060647 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:16.060960 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:16.061720 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.062668 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.063543 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.064067 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.064254 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.066971 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:16.066977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:16.066993 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:16.067027 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:16.069278 (+ 2251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.069963 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.069968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.069974 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.070117 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.070475 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.070494 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.070496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.070942 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:16.071120 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:16.071791 (+ 671us) server_negotiation.cc:299] Negotiation successful
0923 14:41:16.072106 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":138,"threads_started":1}
I20260923 14:41:16.074133 25653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:16.074349 25653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:16.074427 25653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0b80989394294acb48a546ccf602c, State: Initialized, Role: FOLLOWER
I20260923 14:41:16.074865 25653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:16.075018 25653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:16.075098 25653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:16.075196 25653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:16.076239 25653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:16.076619 25653 leader_election.cc:302] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06f0b80989394294acb48a546ccf602c; no voters:
I20260923 14:41:16.076951 25653 leader_election.cc:288] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:16.077630 25658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:16.077874 25658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 LEADER]: Becoming Leader. State: Replica: 06f0b80989394294acb48a546ccf602c, State: Running, Role: LEADER
I20260923 14:41:16.078200 25653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:16.078461 25658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:16.081121 25659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06f0b80989394294acb48a546ccf602c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } } }
I20260923 14:41:16.081228 25659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: This master's current role is: LEADER
W20260923 14:41:16.083232 25672 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:41:16.083312 25672 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:41:16.083284 25660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06f0b80989394294acb48a546ccf602c. Latest consensus state: current_term: 1 leader_uuid: "06f0b80989394294acb48a546ccf602c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } } }
I20260923 14:41:16.083398 25660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:16.083709 25673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:16.084571 25673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:16.090446 25673 catalog_manager.cc:1347] Generated new cluster ID: 211e5fb11ec44698aafbd8724e4b2aea
I20260923 14:41:16.090550 25673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:16.108481 25673 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:16.109844 25673 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:16.121153 25673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Generated new TSK 0
I20260923 14:41:16.121937 25673 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:41:16.154160 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:42039
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:16.259531 25679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:16.259778 25679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:16.259819 25679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:16.263549 25679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:16.263599 25679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:16.263684 25679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:16.268802 25679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:16.269757 25679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:16.270727 25679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:16.280043 25685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.280061 25684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.280067 25687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:16.280179 25679 server_base.cc:1034] running on GCE node
I20260923 14:41:16.280769 25679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:16.281340 25679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:16.282527 25679 hybrid_clock.cc:648] HybridClock initialized: now 1790174476282514 us; error 34 us; skew 500 ppm
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:16.285190 25679 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:41:16.285971 25679 webserver.cc:460] Webserver started at http://127.17.4.129:37101/ using document root <none> and password file <none>
I20260923 14:41:16.286439 25679 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:16.286500 25679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:16.286646 25679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:16.288498 25679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "48618d5f8b94497ca3d545c219ca1c4f"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "c4e2e6f194ec630b82008622bc4a626e"
server_key_iv: "f46f0e4f03edaba3ff105b08389a3152"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.289029 25679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "48618d5f8b94497ca3d545c219ca1c4f"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "c4e2e6f194ec630b82008622bc4a626e"
server_key_iv: "f46f0e4f03edaba3ff105b08389a3152"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.292315 25679 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:41:16.294462 25694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.295601 25679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:16.295710 25679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "48618d5f8b94497ca3d545c219ca1c4f"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "c4e2e6f194ec630b82008622bc4a626e"
server_key_iv: "f46f0e4f03edaba3ff105b08389a3152"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.295858 25679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:16.308275 25679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:16.311139 25679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:16.311316 25679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:16.311872 25679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:16.312593 25679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:16.312635 25679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.312692 25679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:16.312722 25679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.321512 25679 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:43907
I20260923 14:41:16.321539 25807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:43907 every 8 connection(s)
I20260923 14:41:16.322248 25679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:16.329466 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25679
I20260923 14:41:16.329594 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:16.329860 17426 external_mini_cluster.cc:1428] Setting key eec8ccdbbec64921a82aac0896604844
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:16.334614 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.323990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:45641 (local address 127.17.4.190:42039)
0923 14:41:16.324115 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:16.324118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:16.325037 (+ 919us) server_negotiation.cc:407] Connection header received
0923 14:41:16.325795 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:16.325798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:16.325841 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:16.325910 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:16.326928 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.327430 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.328455 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.328675 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.328751 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.331290 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:16.331293 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:16.331295 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:16.331319 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:16.332706 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.333206 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.333211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.333213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.333292 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.333618 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.333622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.333624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.333789 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:16.333893 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:16.334328 (+ 435us) server_negotiation.cc:299] Negotiation successful
0923 14:41:16.334446 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:41:16.335376 25810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.324293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:45641)
0923 14:41:16.324875 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:16.324912 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:16.325629 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:16.326056 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:16.326062 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:16.326364 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:16.326806 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:16.326818 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.327528 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.327530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:16.328355 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:16.328364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.328794 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.328797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:16.328923 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.329531 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:16.329562 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:16.331137 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:16.332827 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:16.332832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:16.332843 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:16.333104 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:16.333389 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:16.333392 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:16.333394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:16.333523 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:16.333891 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:16.333897 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:16.334115 (+ 218us) client_negotiation.cc:769] Sending connection context
0923 14:41:16.334287 (+ 172us) client_negotiation.cc:240] Negotiation successful
0923 14:41:16.334559 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":111,"threads_started":1}
I20260923 14:41:16.336524 25808 heartbeater.cc:347] Connected to a master server at 127.17.4.190:42039
I20260923 14:41:16.336737 25808 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:16.337165 25808 heartbeater.cc:511] Master 127.17.4.190:42039 requested a full tablet report, sending...
I20260923 14:41:16.338747 25617 ts_manager.cc:194] Registered new tserver with Master: 48618d5f8b94497ca3d545c219ca1c4f (127.17.4.129:43907)
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:41:16.339983 25617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:45641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:41:16.356482 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:42039
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:16.460734 25813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:16.460963 25813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:16.461001 25813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:16.464572 25813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:16.464617 25813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:16.464665 25813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:16.469406 25813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:16.470288 25813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:16.471259 25813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:16.480087 25821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.480093 25819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.480093 25818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:16.480341 25813 server_base.cc:1034] running on GCE node
I20260923 14:41:16.480732 25813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:16.481258 25813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:16.482436 25813 hybrid_clock.cc:648] HybridClock initialized: now 1790174476482418 us; error 29 us; skew 500 ppm
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:16.484907 25813 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:41:16.485674 25813 webserver.cc:460] Webserver started at http://127.17.4.130:36385/ using document root <none> and password file <none>
I20260923 14:41:16.486176 25813 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:16.486259 25813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:16.486472 25813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:16.488334 25813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "d9dd7f2c8efb4b61a8fd95ab0e520e9e"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "b995431e8a048c2d9b5dc40fd3d3fddb"
server_key_iv: "8f8ba5c93fd2321dd93b5ff72a1a936d"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.488847 25813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "d9dd7f2c8efb4b61a8fd95ab0e520e9e"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "b995431e8a048c2d9b5dc40fd3d3fddb"
server_key_iv: "8f8ba5c93fd2321dd93b5ff72a1a936d"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.492105 25813 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260923 14:41:16.494215 25828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.495309 25813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:16.495433 25813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "d9dd7f2c8efb4b61a8fd95ab0e520e9e"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "b995431e8a048c2d9b5dc40fd3d3fddb"
server_key_iv: "8f8ba5c93fd2321dd93b5ff72a1a936d"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.495534 25813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:16.513999 25813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:16.516669 25813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:16.516847 25813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:16.517405 25813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:16.518199 25813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:16.518276 25813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.518347 25813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:16.518401 25813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.527017 25813 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:45737
I20260923 14:41:16.527056 25941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:45737 every 8 connection(s)
I20260923 14:41:16.527923 25813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:16.531927 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25813
I20260923 14:41:16.532055 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:16.532312 17426 external_mini_cluster.cc:1428] Setting key 93bf6934a02ea607b177ee25f9f9d7f1
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:16.541918 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.529698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:50847 (local address 127.17.4.190:42039)
0923 14:41:16.529826 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:16.529829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:16.530792 (+ 963us) server_negotiation.cc:407] Connection header received
0923 14:41:16.531667 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:16.531670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:16.531731 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:16.531843 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:16.533323 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.534022 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.535083 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.535457 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.535540 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.538242 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:16.538246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:16.538250 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:16.538281 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:16.539841 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.540420 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.540422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.540423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.540494 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.540874 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.540876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.540877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.541032 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:16.541106 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:16.541716 (+ 610us) server_negotiation.cc:299] Negotiation successful
0923 14:41:16.541804 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:41:16.542925 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.530048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:50847)
0923 14:41:16.530656 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:16.530694 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:16.531448 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:16.532056 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:16.532065 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:16.532496 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:16.533172 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:16.533191 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.534142 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.534145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:16.534961 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:16.534969 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.535613 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.535618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:16.535859 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.536470 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:16.536495 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:16.538080 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:16.539949 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:16.539958 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:16.539975 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:16.540324 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:16.540592 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:16.540597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:16.540599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:16.540776 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:16.541135 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:16.541141 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:16.541452 (+ 311us) client_negotiation.cc:769] Sending connection context
0923 14:41:16.541687 (+ 235us) client_negotiation.cc:240] Negotiation successful
0923 14:41:16.542011 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":110,"threads_started":1}
I20260923 14:41:16.543992 25942 heartbeater.cc:347] Connected to a master server at 127.17.4.190:42039
I20260923 14:41:16.544262 25942 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:16.544781 25942 heartbeater.cc:511] Master 127.17.4.190:42039 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:41:16.545864 25617 ts_manager.cc:194] Registered new tserver with Master: d9dd7f2c8efb4b61a8fd95ab0e520e9e (127.17.4.130:45737)
I20260923 14:41:16.546672 25617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:50847
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:41:16.560698 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:42039
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:16.667173 25947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:16.667371 25947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:16.667407 25947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:16.670955 25947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:16.670995 25947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:16.671068 25947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:16.675863 25947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:16.676764 25947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:16.677702 25947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:16.686636 25947 server_base.cc:1034] running on GCE node
W20260923 14:41:16.686517 25953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.686514 25952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.686837 25955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:16.687206 25947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:16.687870 25947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:16.689055 25947 hybrid_clock.cc:648] HybridClock initialized: now 1790174476689029 us; error 47 us; skew 500 ppm
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:16.691680 25947 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:41:16.692467 25947 webserver.cc:460] Webserver started at http://127.17.4.131:43297/ using document root <none> and password file <none>
I20260923 14:41:16.693012 25947 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:16.693100 25947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:16.693329 25947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:16.695241 25947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "1338cbaeeaa4443f930099b2984ee1e6"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "ad20221bf9a6fc7576b44a026e38c447"
server_key_iv: "b03c8e5688272513da69ac675daeee7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.695850 25947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "1338cbaeeaa4443f930099b2984ee1e6"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "ad20221bf9a6fc7576b44a026e38c447"
server_key_iv: "b03c8e5688272513da69ac675daeee7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.699492 25947 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:41:16.701783 25962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.702912 25947 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:41:16.703044 25947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "1338cbaeeaa4443f930099b2984ee1e6"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "ad20221bf9a6fc7576b44a026e38c447"
server_key_iv: "b03c8e5688272513da69ac675daeee7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.703147 25947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:16.721587 25947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:16.724146 25947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:16.724326 25947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:16.724846 25947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:16.725618 25947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:16.725695 25947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.725760 25947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:16.725806 25947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.734225 25947 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:44453
I20260923 14:41:16.734256 26075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:44453 every 8 connection(s)
I20260923 14:41:16.735070 25947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:16.736474 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 25947
I20260923 14:41:16.736613 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:16.736912 17426 external_mini_cluster.cc:1428] Setting key 870a0831d38cd65f5c9e60284412ee6d
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:16.746899 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.736741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:51121 (local address 127.17.4.190:42039)
0923 14:41:16.736886 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:16.736891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:16.738070 (+ 1179us) server_negotiation.cc:407] Connection header received
0923 14:41:16.738953 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:16.738956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:16.739009 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:16.739093 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:16.740135 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.740623 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.741645 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.741842 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.741912 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.744128 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:16.744131 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:16.744133 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:16.744155 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:16.745283 (+ 1128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.745742 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.745745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.745746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.745817 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:16.746095 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:16.746097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:16.746098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:16.746245 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:16.746316 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:16.746708 (+ 392us) server_negotiation.cc:299] Negotiation successful
0923 14:41:16.746792 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 14:41:16.747596 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:16.737179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:51121)
0923 14:41:16.737920 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:16.737980 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:16.738714 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:16.739220 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:16.739226 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:16.739562 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:16.740020 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:16.740032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.740721 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.740723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:16.741545 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:16.741553 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:16.741954 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:16.741956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:16.742099 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:16.742656 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:16.742671 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:16.743992 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:16.745387 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:16.745391 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:16.745401 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:16.745656 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:16.745893 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:16.745895 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:16.745896 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:16.746017 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:16.746323 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:16.746327 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:16.746528 (+ 201us) client_negotiation.cc:769] Sending connection context
0923 14:41:16.746665 (+ 137us) client_negotiation.cc:240] Negotiation successful
0923 14:41:16.746879 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":144,"threads_started":1}
I20260923 14:41:16.748620 26076 heartbeater.cc:347] Connected to a master server at 127.17.4.190:42039
I20260923 14:41:16.748835 26076 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:16.749302 26076 heartbeater.cc:511] Master 127.17.4.190:42039 requested a full tablet report, sending...
I20260923 14:41:16.750377 25617 ts_manager.cc:194] Registered new tserver with Master: 1338cbaeeaa4443f930099b2984ee1e6 (127.17.4.131:44453)
I20260923 14:41:16.750916 25617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:51121
I20260923 14:41:16.762073 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab.
Entry for principal oryx/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab.
WARNING: no policy specified for oryx/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab.
Entry for principal oryx/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab.
WARNING: no policy specified for oryx/127.17.4.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab.
Entry for principal oryx/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab.
I20260923 14:41:16.831847 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25679
I20260923 14:41:16.837208 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25813
I20260923 14:41:16.842154 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25947
I20260923 14:41:16.847112 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 25585
I20260923 14:41:16.852787 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:42039
--webserver_interface=127.17.4.190
--webserver_port=35819
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:42039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:16.956032 26085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:16.956279 26085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:16.956318 26085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:16.960404 26085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:16.960458 26085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:16.960479 26085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:16.960494 26085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:16.960562 26085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:16.965512 26085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:42039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:42039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=35819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:16.966485 26085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:16.967464 26085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:16.975533 26093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.975556 26091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:16.975600 26090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:16.975690 26085 server_base.cc:1034] running on GCE node
I20260923 14:41:16.976342 26085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:16.977335 26085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:16.978487 26085 hybrid_clock.cc:648] HybridClock initialized: now 1790174476978468 us; error 29 us; skew 500 ppm
Sep 23 14:41:16 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174476, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:16.981094 26085 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:41:16.981851 26085 webserver.cc:460] Webserver started at http://127.17.4.190:35819/ using document root <none> and password file <none>
I20260923 14:41:16.982331 26085 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:16.982393 26085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:16.985935 26085 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:16.987875 26100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:16.989003 26085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:16.989100 26085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "06f0b80989394294acb48a546ccf602c"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "969d3407c214281fa69946239f1edb05"
server_key_iv: "887cdfd253ca61509d0e65fb1676c2b4"
server_key_version: "encryptionkey@0"
I20260923 14:41:16.989579 26085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:17.003160 26085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:17.005575 26085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:17.005704 26085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:17.012267 26085 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:42039
I20260923 14:41:17.012291 26152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:42039 every 8 connection(s)
I20260923 14:41:17.013259 26085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:17.017319 26153 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:41:17.018365 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26085
I20260923 14:41:17.018784 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:43907
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:42039
--webserver_port=37101
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:41:17.018999 26153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Bootstrap starting.
I20260923 14:41:17.034605 26153 log.cc:824] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:17.040858 26153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:41:17.041211 26153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Bootstrap complete.
I20260923 14:41:17.045208 26153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:17.045603 26153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0b80989394294acb48a546ccf602c, State: Initialized, Role: FOLLOWER
I20260923 14:41:17.046064 26153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:17.046204 26153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:17.046290 26153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:17.046449 26153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 1 FOLLOWER]: Advancing to term 2
I20260923 14:41:17.048300 26153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:17.048616 26153 leader_election.cc:302] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06f0b80989394294acb48a546ccf602c; no voters:
I20260923 14:41:17.048928 26153 leader_election.cc:288] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 14:41:17.049001 26157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 2 FOLLOWER]: Leader election won for term 2
I20260923 14:41:17.049230 26157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [term 2 LEADER]: Becoming Leader. State: Replica: 06f0b80989394294acb48a546ccf602c, State: Running, Role: LEADER
I20260923 14:41:17.049510 26157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } }
I20260923 14:41:17.050071 26153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:17.050365 26157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06f0b80989394294acb48a546ccf602c. Latest consensus state: current_term: 2 leader_uuid: "06f0b80989394294acb48a546ccf602c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } } }
I20260923 14:41:17.050488 26157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:17.050817 26161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:17.050824 26158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "06f0b80989394294acb48a546ccf602c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f0b80989394294acb48a546ccf602c" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 42039 } } }
I20260923 14:41:17.051056 26158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:17.053983 26161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:17.054662 26161 catalog_manager.cc:1259] Loaded cluster ID: 211e5fb11ec44698aafbd8724e4b2aea
I20260923 14:41:17.054731 26161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:17.056523 26161 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:17.057063 26161 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 06f0b80989394294acb48a546ccf602c: Loaded TSK: 0
I20260923 14:41:17.057969 26161 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 14:41:17.136490 26155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:17.136700 26155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:17.136739 26155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:17.140635 26155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:17.140681 26155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:17.140772 26155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:17.145718 26155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.129.keytab
--principal=oryx/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:43907
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=37101
--tserver_master_addrs=127.17.4.190:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:17.146644 26155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:17.147537 26155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:17.157737 26179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:17.157779 26182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:17.157752 26180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:17.158243 26155 server_base.cc:1034] running on GCE node
I20260923 14:41:17.158710 26155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:17.159283 26155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:17.160465 26155 hybrid_clock.cc:648] HybridClock initialized: now 1790174477160435 us; error 49 us; skew 500 ppm
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174477, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:17.163287 26155 init.cc:377] Logged in from keytab as oryx/127.17.4.129@KRBTEST.COM (short username oryx)
I20260923 14:41:17.164292 26155 webserver.cc:460] Webserver started at http://127.17.4.129:37101/ using document root <none> and password file <none>
I20260923 14:41:17.164847 26155 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:17.164952 26155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:17.168715 26155 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260923 14:41:17.170790 26189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.172108 26155 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:17.172240 26155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "48618d5f8b94497ca3d545c219ca1c4f"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "c4e2e6f194ec630b82008622bc4a626e"
server_key_iv: "f46f0e4f03edaba3ff105b08389a3152"
server_key_version: "encryptionkey@0"
I20260923 14:41:17.172749 26155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:17.185993 26155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:17.189029 26155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:17.189208 26155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:17.189718 26155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:17.190559 26155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:17.190629 26155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.190696 26155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:17.190748 26155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.200367 26155 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:43907
I20260923 14:41:17.200393 26302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:43907 every 8 connection(s)
I20260923 14:41:17.201299 26155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:17.204699 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26155
I20260923 14:41:17.205190 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:45737
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:42039
--webserver_port=36385
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.217799 26306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.203522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:56113)
0923 14:41:17.206488 (+ 2966us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.206554 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.207336 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.208594 (+ 1258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.208606 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.209121 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.209831 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.209854 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.211129 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.211135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.212746 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.212763 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.213534 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.213541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.213775 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.214411 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.214434 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.217076 (+ 2642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2724,"thread_start_us":115,"threads_started":1}
W20260923 14:41:17.218139 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.203414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:56113 (local address 127.17.4.190:42039)
0923 14:41:17.203909 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.203927 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.206699 (+ 2772us) server_negotiation.cc:407] Connection header received
0923 14:41:17.207813 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.207835 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.208170 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.208435 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.210023 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.210987 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.212897 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.213358 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.213492 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.217322 (+ 3830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:56113: BlockingRecv error: recv got EOF from 127.17.4.129:56113 (error 108)
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":128,"threads_started":1}
W20260923 14:41:17.218442 26303 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:42039 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.4.190:42039: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.224159 26306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.218853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:43351)
0923 14:41:17.218991 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.219009 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.219080 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.219459 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.219462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.219582 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.219667 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.219671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.220700 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.220703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.221231 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.221239 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.221800 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.221803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.221871 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.222347 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.222358 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.224075 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":67}
W20260923 14:41:17.224316 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.218967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:43351 (local address 127.17.4.190:42039)
0923 14:41:17.219219 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.219223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.219235 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:17.219267 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.219269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.219308 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.219381 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.219807 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.220593 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.221334 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.221703 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.221795 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.224214 (+ 2419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:43351: BlockingRecv error: recv got EOF from 127.17.4.129:43351 (error 108)
Metrics: {"server-negotiator.queue_time_us":182}
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.230152 26308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.224605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:55825)
0923 14:41:17.224929 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.224949 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.225024 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.225273 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.225275 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.225421 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.225505 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.225509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.226487 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.226490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.227054 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.227061 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.227657 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.227660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.227740 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.228341 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.228352 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.230040 (+ 1688us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":100,"threads_started":1}
W20260923 14:41:17.230275 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.224722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55825 (local address 127.17.4.190:42039)
0923 14:41:17.224825 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.224829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.225013 (+ 184us) server_negotiation.cc:407] Connection header received
0923 14:41:17.225084 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.225090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.225140 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.225252 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.225605 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.226346 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.227162 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.227499 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.227622 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.230181 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:55825: BlockingRecv error: recv got EOF from 127.17.4.129:55825 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260923 14:41:17.230340 26303 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 14:41:17.316577 26307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:17.316803 26307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:17.316843 26307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:17.320709 26307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:17.320757 26307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:17.320812 26307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:17.325718 26307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.130.keytab
--principal=oryx/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:45737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=36385
--tserver_master_addrs=127.17.4.190:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:17.326941 26307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:17.327909 26307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:17.336807 26313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:17.336814 26314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:17.336921 26307 server_base.cc:1034] running on GCE node
W20260923 14:41:17.336818 26316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:17.337463 26307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:17.338074 26307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:17.339257 26307 hybrid_clock.cc:648] HybridClock initialized: now 1790174477339243 us; error 28 us; skew 500 ppm
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174477, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:17.341899 26307 init.cc:377] Logged in from keytab as oryx/127.17.4.130@KRBTEST.COM (short username oryx)
I20260923 14:41:17.342722 26307 webserver.cc:460] Webserver started at http://127.17.4.130:36385/ using document root <none> and password file <none>
I20260923 14:41:17.343215 26307 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:17.343281 26307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:17.346822 26307 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:17.348783 26323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.350014 26307 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:17.350100 26307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "d9dd7f2c8efb4b61a8fd95ab0e520e9e"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "b995431e8a048c2d9b5dc40fd3d3fddb"
server_key_iv: "8f8ba5c93fd2321dd93b5ff72a1a936d"
server_key_version: "encryptionkey@0"
I20260923 14:41:17.350589 26307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:17.367869 26307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:17.370537 26307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:17.370680 26307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:17.371134 26307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:17.371850 26307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:17.371893 26307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.371929 26307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:17.371944 26307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.380642 26307 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:45737
I20260923 14:41:17.380666 26436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:45737 every 8 connection(s)
I20260923 14:41:17.381517 26307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.391860 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26307
W20260923 14:41:17.391955 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.383288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:42443 (local address 127.17.4.190:42039)
0923 14:41:17.383419 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.383423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.384502 (+ 1079us) server_negotiation.cc:407] Connection header received
0923 14:41:17.385301 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.385303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.385347 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.385418 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.386654 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.387143 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.388283 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.388486 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.388570 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.391839 (+ 3269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:42443: BlockingRecv error: recv got EOF from 127.17.4.130:42443 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:41:17.392331 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:44453
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:42039
--webserver_port=43297
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:41:17.392612 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.383689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:42443)
0923 14:41:17.384364 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.384402 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.385134 (+ 732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.385659 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.385671 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.386084 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.386535 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.386548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.387244 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.387246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.388179 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.388188 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.388607 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.388609 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.388739 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.389275 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.389290 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.391704 (+ 2414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":94,"threads_started":1}
W20260923 14:41:17.393049 26437 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:42039 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.4.190:42039: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.398708 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.393457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:59909)
0923 14:41:17.393625 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.393641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.393707 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.394009 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.394012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.394139 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.394219 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.394223 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.395204 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.395206 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.395711 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.395717 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.396191 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.396195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.396284 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.396789 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.396799 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.398533 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260923 14:41:17.398725 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.393542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:59909 (local address 127.17.4.190:42039)
0923 14:41:17.393651 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.393655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.393689 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:41:17.393805 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.393809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.393861 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.393944 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.394323 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.395084 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.395877 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.396085 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.396194 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.398645 (+ 2451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:59909: BlockingRecv error: recv got EOF from 127.17.4.130:59909 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.403558 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.399169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:55209)
0923 14:41:17.399275 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.399305 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.399370 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.399582 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.399585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.399717 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.399830 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.399836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.400481 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.400485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.400971 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.400978 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.401374 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.401377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.401449 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.401884 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.401894 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.403430 (+ 1536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260923 14:41:17.403626 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.399252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:55209 (local address 127.17.4.190:42039)
0923 14:41:17.399368 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.399372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.399385 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:17.399446 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.399449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.399489 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.399565 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.399930 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.400381 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.401082 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.401277 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.401375 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.403522 (+ 2147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:55209: BlockingRecv error: recv got EOF from 127.17.4.130:55209 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260923 14:41:17.403723 26437 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 14:41:17.497991 26440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:17.498195 26440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:17.498256 26440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:17.502015 26440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:17.502061 26440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:17.502113 26440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:17.507038 26440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/krb5kdc/oryx_127.17.4.131.keytab
--principal=oryx/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:44453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=43297
--tserver_master_addrs=127.17.4.190:42039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:17.507977 26440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:17.508841 26440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:17.517582 26448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:17.517593 26445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:17.517697 26440 server_base.cc:1034] running on GCE node
W20260923 14:41:17.517594 26446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:17.518173 26440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:17.518751 26440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:17.519949 26440 hybrid_clock.cc:648] HybridClock initialized: now 1790174477519924 us; error 35 us; skew 500 ppm
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174477, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:17.522455 26440 init.cc:377] Logged in from keytab as oryx/127.17.4.131@KRBTEST.COM (short username oryx)
I20260923 14:41:17.523154 26440 webserver.cc:460] Webserver started at http://127.17.4.131:43297/ using document root <none> and password file <none>
I20260923 14:41:17.523612 26440 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:17.523674 26440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:17.527105 26440 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:17.528999 26455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.530083 26440 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:17.530167 26440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "1338cbaeeaa4443f930099b2984ee1e6"
format_stamp: "Formatted at 2026-09-23 14:41:16 on dist-test-slave-54kg"
server_key: "ad20221bf9a6fc7576b44a026e38c447"
server_key_iv: "b03c8e5688272513da69ac675daeee7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:17.530599 26440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:17.552942 26440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:17.555619 26440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:17.555840 26440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:17.556344 26440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:17.557070 26440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:17.557132 26440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.557190 26440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:17.557238 26440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:17.565721 26440 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:44453
I20260923 14:41:17.565749 26568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:44453 every 8 connection(s)
I20260923 14:41:17.566594 26440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:17.569316 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26440
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
W20260923 14:41:17.577790 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.568158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:45813 (local address 127.17.4.190:42039)
0923 14:41:17.568294 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.568298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.569002 (+ 704us) server_negotiation.cc:407] Connection header received
0923 14:41:17.570527 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.570530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.570572 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.570635 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.571829 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.572436 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.573823 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.574029 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.574127 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.577671 (+ 3544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:45813: BlockingRecv error: recv got EOF from 127.17.4.131:45813 (error 108)
Metrics: {"server-negotiator.queue_time_us":52,"spinlock_wait_cycles":8448}
I20260923 14:41:17.578377 26571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.568503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:45813)
0923 14:41:17.568871 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.568907 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.570314 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.570821 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.570830 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.571146 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.571651 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.571669 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.572602 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.572608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.573702 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.573710 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.574159 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.574162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.574310 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.574804 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.574820 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.577570 (+ 2750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":96,"threads_started":1}
W20260923 14:41:17.578774 26569 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:42039 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.4.190:42039: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
I20260923 14:41:17.578928 26573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.570288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56126 (local address 127.17.4.190:42039)
0923 14:41:17.570529 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.570533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.570555 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:41:17.570596 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.570598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.570662 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.570744 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.571410 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.572066 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.572995 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.573317 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.573410 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.574754 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:17.574761 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:17.574775 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:17.574802 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:17.576679 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:17.577187 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:17.577191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:17.577209 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:17.577354 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:17.577655 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:17.577658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:17.577660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:17.578046 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:17.578182 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:17.578467 (+ 285us) server_negotiation.cc:299] Negotiation successful
0923 14:41:17.578779 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":87,"threads_started":1}
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.583598 26571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.579131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:42705)
0923 14:41:17.579276 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.579288 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.579389 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.579596 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.579598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.579736 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.579862 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.579871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.580611 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.580613 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.581285 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.581294 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.581677 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.581679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.581741 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.582065 (+ 324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.582075 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.583517 (+ 1442us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89}
W20260923 14:41:17.583757 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.579179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:42705 (local address 127.17.4.190:42039)
0923 14:41:17.579262 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.579265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.579356 (+ 91us) server_negotiation.cc:407] Connection header received
0923 14:41:17.579465 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.579470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.579501 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.579584 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.579969 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.580500 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.581378 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.581588 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.581664 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.583624 (+ 1960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:42705: BlockingRecv error: recv got EOF from 127.17.4.131:42705 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:17 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:17.588238 26571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:17.584125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:39877)
0923 14:41:17.584243 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:17.584253 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:17.584307 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:17.584474 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:17.584476 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:17.584589 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:17.584646 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.584650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.585265 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.585267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.585741 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:17.585748 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.586239 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.586241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:17.586293 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.586616 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:17.586626 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:17.588137 (+ 1511us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260923 14:41:17.588366 26305 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:17.584211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:39877 (local address 127.17.4.190:42039)
0923 14:41:17.584324 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:17.584326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:17.584337 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:41:17.584362 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:17.584364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:17.584390 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:17.584449 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:17.584734 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.585162 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.585833 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:17.586132 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:17.586227 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:17.588233 (+ 2006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:39877: BlockingRecv error: recv got EOF from 127.17.4.131:39877 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260923 14:41:17.588429 26569 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 23 14:41:18 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:18 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:18.244001 26574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:18.230960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:49503)
0923 14:41:18.231288 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:18.231305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:18.231428 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:18.231749 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:18.231751 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:18.232002 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:18.232132 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:18.232139 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.232977 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.232983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:18.233590 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:18.233598 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.234069 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.234072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:18.234171 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:18.241711 (+ 7540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:18.241725 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:18.243814 (+ 2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":88,"threads_started":1}
W20260923 14:41:18.244128 26575 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:18.231025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:49503 (local address 127.17.4.190:42039)
0923 14:41:18.231304 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:18.231307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:18.231367 (+ 60us) server_negotiation.cc:407] Connection header received
0923 14:41:18.231570 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:18.231574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:18.231628 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:18.231726 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:18.232250 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.232840 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.233710 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.233935 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.234058 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:18.243979 (+ 9921us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:49503: BlockingRecv error: recv got EOF from 127.17.4.129:49503 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":103,"threads_started":1}
Sep 23 14:41:18 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:18 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:18.409272 26576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:18.404303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:39805)
0923 14:41:18.404567 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:18.404579 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:18.404664 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:18.404887 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:18.404888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:18.405050 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:18.405140 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:18.405145 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.405876 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.405879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:18.406430 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:18.406437 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.406843 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.406846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:18.406902 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:18.407540 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:18.407551 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:18.409172 (+ 1621us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
W20260923 14:41:18.409397 26575 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:18.404371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:39805 (local address 127.17.4.190:42039)
0923 14:41:18.404503 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:18.404507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:18.404644 (+ 137us) server_negotiation.cc:407] Connection header received
0923 14:41:18.404749 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:18.404751 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:18.404791 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:18.404854 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:18.405236 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.405764 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.406559 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.406755 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.406822 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:18.409289 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:39805: BlockingRecv error: recv got EOF from 127.17.4.130:39805 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 23 14:41:18 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:18 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:18.594627 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:18.589049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:41307)
0923 14:41:18.589338 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:18.589351 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:18.589469 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:18.589721 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:18.589723 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:18.589914 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:18.590020 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:18.590026 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.590754 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.590757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:18.591311 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:18.591318 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.591799 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.591804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:18.591900 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:18.592367 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:18.592377 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:18.594479 (+ 2102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":111,"threads_started":1}
W20260923 14:41:18.594662 26575 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:18.589089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:41307 (local address 127.17.4.190:42039)
0923 14:41:18.589251 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:18.589256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:18.589420 (+ 164us) server_negotiation.cc:407] Connection header received
0923 14:41:18.589572 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:18.589575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:18.589624 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:18.589704 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:18.590135 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.590641 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.591431 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:18.591650 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:18.591764 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:18.594571 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:41307: BlockingRecv error: recv got EOF from 127.17.4.131:41307 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 23 14:41:19 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:19 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:19.250065 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:19.244827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:46149)
0923 14:41:19.245106 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:19.245119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:19.245206 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:19.245472 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:19.245474 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:19.245645 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:19.245738 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:19.245743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.246490 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.246493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:19.247077 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:19.247086 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.247490 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.247492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:19.247552 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:19.248156 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:19.248168 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:19.249936 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":65,"threads_started":1}
W20260923 14:41:19.250237 26579 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:19.244887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:46149 (local address 127.17.4.190:42039)
0923 14:41:19.245169 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:19.245173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:19.245185 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:19.245291 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:19.245293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:19.245351 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:19.245426 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:19.245834 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.246354 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.247179 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.247384 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.247454 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:19.250073 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:46149: BlockingRecv error: recv got EOF from 127.17.4.129:46149 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":130,"threads_started":1}
Sep 23 14:41:19 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:19 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:19.415422 26580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:19.410097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:36497)
0923 14:41:19.410360 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:19.410373 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:19.410465 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:19.410693 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:19.410695 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:19.410861 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:19.410952 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:19.410956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.411721 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.411723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:19.412342 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:19.412354 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.412956 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.412976 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:19.413065 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:19.413589 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:19.413600 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:19.415273 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":77,"threads_started":1}
W20260923 14:41:19.415584 26579 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:19.410169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:36497 (local address 127.17.4.190:42039)
0923 14:41:19.410309 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:19.410313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:19.410441 (+ 128us) server_negotiation.cc:407] Connection header received
0923 14:41:19.410542 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:19.410544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:19.410585 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:19.410656 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:19.411087 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.411628 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.412485 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.412831 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.412968 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:19.415426 (+ 2458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:36497: BlockingRecv error: recv got EOF from 127.17.4.130:36497 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 23 14:41:19 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:19 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:19.600430 26581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:19.595333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:41033)
0923 14:41:19.595625 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:19.595639 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:19.595735 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:19.596013 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:19.596015 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:19.596181 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:19.596278 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:19.596283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.596977 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.596979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:19.597564 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:19.597572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.597984 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.597986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:19.598043 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:19.598574 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:19.598585 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:19.600321 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":107,"threads_started":1}
W20260923 14:41:19.600550 26579 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:19.595486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:41033 (local address 127.17.4.190:42039)
0923 14:41:19.595622 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:19.595625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:19.595685 (+ 60us) server_negotiation.cc:407] Connection header received
0923 14:41:19.595858 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:19.595860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:19.595905 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:19.595969 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:19.596377 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.596888 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.597662 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:19.597891 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:19.597962 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:19.600442 (+ 2480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:41033: BlockingRecv error: recv got EOF from 127.17.4.131:41033 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 23 14:41:20 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:20 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:20.256418 26582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:20.250757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:47497)
0923 14:41:20.251059 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:20.251073 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:20.251205 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:20.251454 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:20.251456 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:20.251622 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:20.251718 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:20.251723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.252608 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.252610 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:20.253154 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:20.253161 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.253647 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.253651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:20.253734 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:20.254293 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:20.254305 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:20.256308 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":91,"threads_started":1}
W20260923 14:41:20.256672 26583 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:20.250814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:47497 (local address 127.17.4.190:42039)
0923 14:41:20.251083 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:20.251087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:20.251130 (+ 43us) server_negotiation.cc:407] Connection header received
0923 14:41:20.251295 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:20.251298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:20.251339 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:20.251414 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:20.251837 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.252496 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.253246 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.253536 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.253612 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:20.256507 (+ 2895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:47497: BlockingRecv error: recv got EOF from 127.17.4.129:47497 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":123,"threads_started":1}
Sep 23 14:41:20 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:20 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:20.421177 26584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:20.416248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:47213)
0923 14:41:20.416493 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:20.416506 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:20.416599 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:20.416819 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:20.416821 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:20.416999 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:20.417099 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:20.417104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.417830 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.417832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:20.418385 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:20.418392 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.418798 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.418800 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:20.418857 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:20.419317 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:20.419328 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:20.421066 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":64,"threads_started":1}
W20260923 14:41:20.421396 26583 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:20.416330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:47213 (local address 127.17.4.190:42039)
0923 14:41:20.416507 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:20.416510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:20.416575 (+ 65us) server_negotiation.cc:407] Connection header received
0923 14:41:20.416675 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:20.416677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:20.416719 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:20.416786 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:20.417190 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.417739 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.418491 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.418705 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.418784 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:20.421262 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:47213: BlockingRecv error: recv got EOF from 127.17.4.130:47213 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Sep 23 14:41:20 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:20 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:20.606429 26585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:20.601296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:34747)
0923 14:41:20.601557 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:20.601571 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:20.601666 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:20.601900 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:20.601902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:20.602077 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:20.602176 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:20.602181 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.602880 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.602883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:20.603443 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:20.603450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.603893 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.603896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:20.603957 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:20.604423 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:20.604434 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:20.606239 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":88,"threads_started":1}
W20260923 14:41:20.606448 26583 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:20.601359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:34747 (local address 127.17.4.190:42039)
0923 14:41:20.601496 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:20.601499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:20.601639 (+ 140us) server_negotiation.cc:407] Connection header received
0923 14:41:20.601744 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:20.601747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:20.601790 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:20.601864 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:20.602271 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.602790 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.603539 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:20.603754 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:20.603857 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:20.606359 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:34747: BlockingRecv error: recv got EOF from 127.17.4.131:34747 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 23 14:41:21 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:21 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:21.262868 26586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:21.257257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:55483)
0923 14:41:21.257619 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:21.257636 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:21.257765 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:21.258096 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:21.258099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:21.258305 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:21.258402 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:21.258408 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.259125 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.259127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:21.259721 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:21.259728 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.260189 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.260192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:21.260251 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:21.260819 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:21.260831 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:21.262704 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":117,"threads_started":1}
W20260923 14:41:21.262933 26587 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:21.257321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55483 (local address 127.17.4.190:42039)
0923 14:41:21.257650 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:21.257653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:21.257716 (+ 63us) server_negotiation.cc:407] Connection header received
0923 14:41:21.257866 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:21.257869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:21.257925 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:21.258033 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:21.258521 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.259035 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.259859 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.260092 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.260168 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:21.262815 (+ 2647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:55483: BlockingRecv error: recv got EOF from 127.17.4.129:55483 (error 108)
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":128,"threads_started":1}
Sep 23 14:41:21 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:21 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:21.427119 26588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:21.421886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:48639)
0923 14:41:21.422196 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:21.422208 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:21.422309 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:21.422550 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:21.422552 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:21.422725 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:21.422820 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:21.422825 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.423528 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.423530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:21.424167 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:21.424175 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.424559 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.424562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:21.424619 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:21.425184 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:21.425195 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:21.427008 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":139,"threads_started":1}
W20260923 14:41:21.427277 26587 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:21.421972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:48639 (local address 127.17.4.190:42039)
0923 14:41:21.422114 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:21.422118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:21.422280 (+ 162us) server_negotiation.cc:407] Connection header received
0923 14:41:21.422398 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:21.422401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:21.422442 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:21.422508 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:21.422914 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.423438 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.424266 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.424468 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.424540 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:21.427129 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:48639: BlockingRecv error: recv got EOF from 127.17.4.130:48639 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 23 14:41:21 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:21 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:21.613044 26589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:21.607208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:44199)
0923 14:41:21.607582 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:21.607604 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:21.607743 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:21.608083 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:21.608086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:21.608320 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:21.608420 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:21.608425 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.609191 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.609197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:21.609765 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:21.609772 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.610213 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.610217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:21.610301 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:21.610861 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:21.610872 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:21.612841 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":100,"threads_started":1}
W20260923 14:41:21.613097 26587 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:21.607321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:44199 (local address 127.17.4.190:42039)
0923 14:41:21.607541 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:21.607545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:21.607682 (+ 137us) server_negotiation.cc:407] Connection header received
0923 14:41:21.607914 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:21.607917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:21.607970 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:21.608057 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:21.608555 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.609084 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.609879 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:21.610104 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:21.610210 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:21.612993 (+ 2783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:44199: BlockingRecv error: recv got EOF from 127.17.4.131:44199 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
Sep 23 14:41:22 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:22 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:22.269225 26590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:22.263711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:43025)
0923 14:41:22.263978 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:22.263991 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:22.264071 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:22.264303 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:22.264305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:22.264477 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:22.264577 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:22.264582 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.265381 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.265383 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:22.265935 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:22.265942 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.266391 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.266393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:22.266448 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:22.266922 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:22.266933 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:22.269052 (+ 2119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":102,"threads_started":1}
W20260923 14:41:22.269284 26591 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:22.263797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:43025 (local address 127.17.4.190:42039)
0923 14:41:22.264048 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:22.264051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:22.264064 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:22.264158 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:22.264160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:22.264202 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:22.264277 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:22.264732 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.265291 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.266068 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.266292 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.266379 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:22.269168 (+ 2789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:43025: BlockingRecv error: recv got EOF from 127.17.4.129:43025 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":79,"threads_started":1}
Sep 23 14:41:22 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:22 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:22.433135 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:22.427877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:48309)
0923 14:41:22.428164 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:22.428177 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:22.428300 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:22.428554 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:22.428557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:22.428759 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:22.428845 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:22.428850 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.429606 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.429611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:22.430203 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:22.430211 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.430665 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.430668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:22.430763 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:22.431265 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:22.431278 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:22.432971 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":91,"threads_started":1}
W20260923 14:41:22.433220 26591 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:22.427963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:48309 (local address 127.17.4.190:42039)
0923 14:41:22.428123 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:22.428128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:22.428254 (+ 126us) server_negotiation.cc:407] Connection header received
0923 14:41:22.428401 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:22.428404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:22.428451 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:22.428534 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:22.428961 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.429501 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.430329 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.430554 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.430652 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:22.433112 (+ 2460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:48309: BlockingRecv error: recv got EOF from 127.17.4.130:48309 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 23 14:41:22 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:22 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:22.619331 26593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:22.613868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:51993)
0923 14:41:22.614157 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:22.614175 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:22.614295 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:22.614553 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:22.614556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:22.614749 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:22.614836 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:22.614842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.615560 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.615565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:22.616176 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:22.616185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.616639 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.616642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:22.616730 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:22.617185 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:22.617196 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:22.619176 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":104,"threads_started":1}
W20260923 14:41:22.619444 26591 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:22.613947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:51993 (local address 127.17.4.190:42039)
0923 14:41:22.614128 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:22.614132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:22.614244 (+ 112us) server_negotiation.cc:407] Connection header received
0923 14:41:22.614385 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:22.614390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:22.614436 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:22.614520 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:22.614944 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.615455 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.616291 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:22.616533 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:22.616638 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:22.619325 (+ 2687us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:51993: BlockingRecv error: recv got EOF from 127.17.4.131:51993 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Sep 23 14:41:23 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:23 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:23.283653 26594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:23.270140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:60919)
0923 14:41:23.270399 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:23.270418 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:23.270509 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:23.270771 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:23.270773 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:23.270968 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:23.271064 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:23.271070 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.271854 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.271857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:23.272399 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:23.272406 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.272818 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.272820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:23.272878 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:23.281789 (+ 8911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:23.281801 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:23.283539 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":66,"threads_started":1}
W20260923 14:41:23.283887 26595 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:23.270184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:60919 (local address 127.17.4.190:42039)
0923 14:41:23.270445 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:23.270449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:23.270463 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:41:23.270586 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:23.270588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:23.270629 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:23.270716 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:23.271181 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.271728 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.272497 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.272728 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.272803 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:23.283672 (+ 10869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:60919: BlockingRecv error: recv got EOF from 127.17.4.129:60919 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":105,"threads_started":1}
Sep 23 14:41:23 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:23 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:23.439185 26596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:23.433904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:40479)
0923 14:41:23.434266 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:23.434278 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:23.434433 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:23.434682 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:23.434685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:23.434894 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:23.434983 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:23.434988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.435720 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.435726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:23.436364 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:23.436372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.436802 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.436805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:23.436889 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:23.437395 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:23.437406 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:23.439076 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":94,"threads_started":1}
W20260923 14:41:23.439304 26595 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:23.433953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:40479 (local address 127.17.4.190:42039)
0923 14:41:23.434210 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:23.434216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:23.434341 (+ 125us) server_negotiation.cc:407] Connection header received
0923 14:41:23.434532 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:23.434535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:23.434581 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:23.434661 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:23.435104 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.435604 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.436479 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.436698 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.436801 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:23.439192 (+ 2391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:40479: BlockingRecv error: recv got EOF from 127.17.4.130:40479 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 23 14:41:23 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:23 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:23.625589 26597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:23.620300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:45375)
0923 14:41:23.620568 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:23.620581 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:23.620704 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:23.620945 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:23.620948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:23.621146 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:23.621246 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:23.621251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.621921 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.621926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:23.622441 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:23.622448 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.622895 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.622898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:23.622975 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:23.623508 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:23.623522 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:23.625483 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":84,"threads_started":1}
W20260923 14:41:23.625770 26595 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:23.620362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:45375 (local address 127.17.4.190:42039)
0923 14:41:23.620510 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:23.620516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:23.620650 (+ 134us) server_negotiation.cc:407] Connection header received
0923 14:41:23.620795 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:23.620797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:23.620843 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:23.620926 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:23.621349 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.621828 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.622562 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:23.622799 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:23.622895 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:23.625604 (+ 2709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:45375: BlockingRecv error: recv got EOF from 127.17.4.131:45375 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 23 14:41:24 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:24 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:24.289343 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:24.284457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:40683)
0923 14:41:24.284741 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:24.284754 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:24.284859 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:24.285093 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:24.285095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:24.285263 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:24.285354 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:24.285359 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.286085 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.286088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:24.286638 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:24.286644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.287038 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.287040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:24.287096 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:24.287555 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:24.287566 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:24.289237 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":87,"threads_started":1}
W20260923 14:41:24.289518 26599 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:24.284512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:40683 (local address 127.17.4.190:42039)
0923 14:41:24.284738 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:24.284741 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:24.284817 (+ 76us) server_negotiation.cc:407] Connection header received
0923 14:41:24.284946 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:24.284948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:24.284989 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:24.285063 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:24.285444 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.285998 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.286729 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.286952 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.287025 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:24.289355 (+ 2330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:40683: BlockingRecv error: recv got EOF from 127.17.4.129:40683 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":80,"threads_started":1}
Sep 23 14:41:24 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:24 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:24.445015 26600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:24.439996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:54979)
0923 14:41:24.440273 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:24.440285 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:24.440414 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:24.440708 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:24.440710 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:24.440887 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:24.440988 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:24.440993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.441676 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.441679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:24.442193 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:24.442199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.442547 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.442549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:24.442602 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:24.443122 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:24.443133 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:24.444854 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":73,"threads_started":1}
W20260923 14:41:24.445080 26599 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:24.440062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:54979 (local address 127.17.4.190:42039)
0923 14:41:24.440193 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:24.440198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:24.440348 (+ 150us) server_negotiation.cc:407] Connection header received
0923 14:41:24.440497 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:24.440499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:24.440542 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:24.440605 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:24.441088 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.441592 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.442279 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.442465 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.442530 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:24.444966 (+ 2436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:54979: BlockingRecv error: recv got EOF from 127.17.4.130:54979 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 23 14:41:24 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:24 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:24.631239 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:24.626345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:44625)
0923 14:41:24.626636 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:24.626649 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:24.626741 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:24.626965 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:24.626967 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:24.627153 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:24.627237 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:24.627242 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.627935 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.627937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:24.628484 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:24.628491 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.628857 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.628859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:24.628915 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:24.629352 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:24.629362 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:24.631056 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":90,"threads_started":1}
W20260923 14:41:24.631469 26599 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:24.626399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:44625 (local address 127.17.4.190:42039)
0923 14:41:24.626526 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:24.626530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:24.626712 (+ 182us) server_negotiation.cc:407] Connection header received
0923 14:41:24.626804 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:24.626806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:24.626854 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:24.626923 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:24.627319 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.627856 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.628573 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:24.628771 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:24.628843 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:24.631205 (+ 2362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:44625: BlockingRecv error: recv got EOF from 127.17.4.131:44625 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 23 14:41:25 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:25 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:25.295377 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:25.290085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:50723)
0923 14:41:25.290347 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:25.290359 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:25.290470 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:25.290705 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:25.290707 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:25.290905 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:25.291002 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:25.291007 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.291701 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.291703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:25.292355 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:25.292364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.292817 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.292820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:25.292889 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:25.293455 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:25.293466 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:25.295257 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":99,"threads_started":1}
W20260923 14:41:25.295540 26603 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:25.290187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:50723 (local address 127.17.4.190:42039)
0923 14:41:25.290422 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:25.290425 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:25.290437 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:25.290552 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:25.290554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:25.290596 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:25.290671 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:25.291092 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.291612 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.292460 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.292726 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.292804 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:25.295373 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:50723: BlockingRecv error: recv got EOF from 127.17.4.129:50723 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
Sep 23 14:41:25 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:25 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:25.451378 26604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:25.445964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:46149)
0923 14:41:25.446270 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:25.446284 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:25.446406 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:25.446697 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:25.446699 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:25.446904 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:25.447001 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:25.447006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.447867 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.447869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:25.448409 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:25.448415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.448795 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.448797 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:25.448854 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:25.449317 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:25.449327 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:25.451270 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":109,"threads_started":1}
W20260923 14:41:25.451500 26603 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:25.445971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:46149 (local address 127.17.4.190:42039)
0923 14:41:25.446137 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:25.446143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:25.446355 (+ 212us) server_negotiation.cc:407] Connection header received
0923 14:41:25.446509 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:25.446512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:25.446567 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:25.446675 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:25.447096 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.447786 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.448497 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.448708 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.448782 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:25.451384 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:46149: BlockingRecv error: recv got EOF from 127.17.4.130:46149 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 23 14:41:25 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:25 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:25.638365 26605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:25.632087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:51527)
0923 14:41:25.632351 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:25.632365 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:25.632501 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:25.632753 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:25.632756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:25.632960 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:25.633049 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:25.633054 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.633899 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.633903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:25.634839 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:25.634849 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.635288 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.635292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:25.635373 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:25.636012 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:25.636025 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:25.638200 (+ 2175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
W20260923 14:41:25.638641 26603 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:25.632151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:51527 (local address 127.17.4.190:42039)
0923 14:41:25.632308 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:25.632313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:25.632445 (+ 132us) server_negotiation.cc:407] Connection header received
0923 14:41:25.632600 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:25.632603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:25.632650 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:25.632736 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:25.633156 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.633766 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.634974 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:25.635183 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:25.635286 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:25.638359 (+ 3073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:51527: BlockingRecv error: recv got EOF from 127.17.4.131:51527 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Sep 23 14:41:26 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:26 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:26.301692 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:26.296114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:48611)
0923 14:41:26.296356 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:26.296371 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:26.296473 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:26.296760 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:26.296779 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:26.297033 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:26.297160 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:26.297169 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.298154 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.298156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:26.298711 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:26.298719 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.299134 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.299136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:26.299194 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:26.299667 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:26.299677 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:26.301520 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
W20260923 14:41:26.301750 26607 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:26.296143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:48611 (local address 127.17.4.190:42039)
0923 14:41:26.296369 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:26.296373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:26.296442 (+ 69us) server_negotiation.cc:407] Connection header received
0923 14:41:26.296554 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:26.296556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:26.296631 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:26.296731 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:26.297289 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.298057 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.298815 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.299042 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.299123 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:26.301636 (+ 2513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:48611: BlockingRecv error: recv got EOF from 127.17.4.129:48611 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":82,"threads_started":1}
Sep 23 14:41:26 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:26 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:26.457734 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:26.452334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:57063)
0923 14:41:26.452600 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:26.452613 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:26.452705 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:26.452913 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:26.452915 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:26.453087 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:26.453178 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:26.453182 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.453889 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.453892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:26.454654 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:26.454663 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.455199 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.455203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:26.455276 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:26.455825 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:26.455835 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:26.457605 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":103,"threads_started":1}
W20260923 14:41:26.457880 26607 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:26.452368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:57063 (local address 127.17.4.190:42039)
0923 14:41:26.452492 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:26.452495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:26.452671 (+ 176us) server_negotiation.cc:407] Connection header received
0923 14:41:26.452776 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:26.452778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:26.452818 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:26.452883 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:26.453265 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.453795 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.454777 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.455065 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.455197 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:26.457736 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:57063: BlockingRecv error: recv got EOF from 127.17.4.130:57063 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 23 14:41:26 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:26 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:26.645239 26609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:26.639359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:34397)
0923 14:41:26.639639 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:26.639660 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:26.639802 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:26.640091 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:26.640095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:26.640434 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:26.640581 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:26.640588 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.641434 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.641438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:26.642282 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:26.642293 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.642737 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.642740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:26.642795 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:26.643299 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:26.643312 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:26.645126 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":106,"threads_started":1}
W20260923 14:41:26.645395 26607 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:26.639377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:34397 (local address 127.17.4.190:42039)
0923 14:41:26.639535 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:26.639540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:26.639723 (+ 183us) server_negotiation.cc:407] Connection header received
0923 14:41:26.639900 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:26.639903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:26.639962 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:26.640063 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:26.640697 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.641303 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.642397 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:26.642644 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:26.642723 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:26.645249 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:34397: BlockingRecv error: recv got EOF from 127.17.4.131:34397 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 23 14:41:27 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:27 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:27.307816 26610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:27.302537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:57511)
0923 14:41:27.302805 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:27.302819 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:27.302896 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:27.303111 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:27.303113 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:27.303283 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:27.303374 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:27.303379 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.304349 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.304352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:27.305025 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:27.305035 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.305450 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.305452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:27.305515 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:27.305999 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:27.306009 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:27.307667 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":103,"threads_started":1}
W20260923 14:41:27.307998 26611 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:27.302604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:57511 (local address 127.17.4.190:42039)
0923 14:41:27.302857 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:27.302861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:27.302874 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:27.302977 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:27.302979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:27.303022 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:27.303101 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:27.303481 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.304238 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.305128 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.305359 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.305437 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:27.307839 (+ 2402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:57511: BlockingRecv error: recv got EOF from 127.17.4.129:57511 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":100,"threads_started":1}
Sep 23 14:41:27 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:27 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:27.463956 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:27.458438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:41987)
0923 14:41:27.458733 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:27.458746 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:27.458864 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:27.459135 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:27.459138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:27.459353 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:27.459449 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:27.459455 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.460230 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.460236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:27.460777 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:27.460783 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.461292 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.461295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:27.461380 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:27.461930 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:27.461948 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:27.463847 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":103,"threads_started":1}
W20260923 14:41:27.464105 26611 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:27.458504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41987 (local address 127.17.4.190:42039)
0923 14:41:27.458647 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:27.458651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:27.458821 (+ 170us) server_negotiation.cc:407] Connection header received
0923 14:41:27.458970 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:27.458975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:27.459026 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:27.459107 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:27.459562 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.460133 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.460891 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.461182 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.461289 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:27.463963 (+ 2674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:41987: BlockingRecv error: recv got EOF from 127.17.4.130:41987 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 23 14:41:27 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:27 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:27.651638 26613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:27.646068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:59389)
0923 14:41:27.646354 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:27.646373 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:27.646497 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:27.646783 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:27.646786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:27.647045 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:27.647176 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:27.647184 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.648124 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.648127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:27.648712 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:27.648719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.649112 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.649114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:27.649173 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:27.649614 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:27.649625 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:27.651526 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":84,"threads_started":1}
W20260923 14:41:27.651746 26611 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:27.646360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:59389 (local address 127.17.4.190:42039)
0923 14:41:27.646499 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:27.646503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:27.646518 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:41:27.646595 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:27.646598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:27.646656 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:27.646742 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:27.647298 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.648032 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.648805 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:27.649024 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:27.649099 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:27.651636 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:59389: BlockingRecv error: recv got EOF from 127.17.4.131:59389 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 23 14:41:28 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:28 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:28.319453 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:28.308664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:53417)
0923 14:41:28.308922 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:28.308935 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:28.309022 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:28.309275 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:28.309277 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:28.309449 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:28.309553 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:28.309558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.310259 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.310261 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:28.310808 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:28.310814 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.311228 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.311230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:28.311287 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:28.317371 (+ 6084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:28.317383 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:28.319285 (+ 1902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":82,"threads_started":1}
W20260923 14:41:28.319561 26615 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:28.308742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53417 (local address 127.17.4.190:42039)
0923 14:41:28.308971 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:28.308975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:28.308988 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:28.309108 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:28.309110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:28.309151 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:28.309227 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:28.309647 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.310169 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.310915 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.311136 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.311216 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:28.319434 (+ 8218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:53417: BlockingRecv error: recv got EOF from 127.17.4.129:53417 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":59,"threads_started":1}
Sep 23 14:41:28 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:28 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:28.469909 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:28.464830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:43299)
0923 14:41:28.465108 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:28.465120 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:28.465212 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:28.465421 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:28.465423 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:28.465594 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:28.465685 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:28.465690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.466388 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.466391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:28.466935 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:28.466942 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.467333 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.467336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:28.467422 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:28.467982 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:28.467993 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:28.469762 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":97,"threads_started":1}
W20260923 14:41:28.470281 26615 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:28.464890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:43299 (local address 127.17.4.190:42039)
0923 14:41:28.465019 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:28.465022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:28.465179 (+ 157us) server_negotiation.cc:407] Connection header received
0923 14:41:28.465283 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:28.465285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:28.465325 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:28.465390 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:28.465770 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.466286 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.467026 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.467228 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.467310 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:28.469919 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:43299: BlockingRecv error: recv got EOF from 127.17.4.130:43299 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 23 14:41:28 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:28 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:28.657546 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:28.652596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:54981)
0923 14:41:28.652842 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:28.652857 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:28.652956 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:28.653169 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:28.653171 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:28.653400 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:28.653506 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:28.653512 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.654185 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.654187 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:28.654786 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:28.654795 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.655190 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.655192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:28.655246 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:28.655710 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:28.655719 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:28.657418 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":91,"threads_started":1}
W20260923 14:41:28.657823 26615 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:28.652627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:54981 (local address 127.17.4.190:42039)
0923 14:41:28.652754 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:28.652759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:28.652923 (+ 164us) server_negotiation.cc:407] Connection header received
0923 14:41:28.653029 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:28.653031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:28.653075 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:28.653141 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:28.653596 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.654096 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.654882 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:28.655088 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:28.655175 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:28.657563 (+ 2388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:54981: BlockingRecv error: recv got EOF from 127.17.4.131:54981 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 23 14:41:29 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:29 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:29.325242 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:29.320125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:37685)
0923 14:41:29.320388 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:29.320405 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:29.320511 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:29.320767 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:29.320769 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:29.320965 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:29.321055 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:29.321059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.321800 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.321802 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:29.322348 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:29.322355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.322744 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.322746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:29.322806 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:29.323290 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:29.323300 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:29.325068 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":71,"threads_started":1}
W20260923 14:41:29.325304 26619 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:29.320247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:37685 (local address 127.17.4.190:42039)
0923 14:41:29.320559 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:29.320562 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:29.320574 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:29.320623 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:29.320625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:29.320663 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:29.320737 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:29.321158 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.321716 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.322441 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.322654 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.322729 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:29.325182 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:37685: BlockingRecv error: recv got EOF from 127.17.4.129:37685 (error 108)
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":118,"threads_started":1}
Sep 23 14:41:29 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:29 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:29.476907 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:29.470711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:55373)
0923 14:41:29.471008 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:29.471020 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:29.471113 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:29.471406 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:29.471409 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:29.471653 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:29.471836 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:29.471844 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.472755 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.472761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:29.473546 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:29.473557 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.474298 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.474305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:29.474393 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:29.474959 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:29.474978 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:29.476787 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":78,"threads_started":1}
W20260923 14:41:29.477085 26619 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:29.470774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:55373 (local address 127.17.4.190:42039)
0923 14:41:29.470940 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:29.470946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:29.471088 (+ 142us) server_negotiation.cc:407] Connection header received
0923 14:41:29.471211 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:29.471215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:29.471272 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:29.471361 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:29.471962 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.472603 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.473666 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.474059 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.474169 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:29.476965 (+ 2796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:55373: BlockingRecv error: recv got EOF from 127.17.4.130:55373 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 23 14:41:29 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:29 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:29.664094 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:29.658424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:56573)
0923 14:41:29.658672 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:29.658687 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:29.658795 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:29.659041 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:29.659043 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:29.659235 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:29.659336 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:29.659341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.660281 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.660285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:29.660920 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:29.660929 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.661364 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.661366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:29.661437 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:29.662035 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:29.662047 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:29.663967 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":88,"threads_started":1}
W20260923 14:41:29.664250 26619 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:29.658459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:56573 (local address 127.17.4.190:42039)
0923 14:41:29.658603 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:29.658606 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:29.658765 (+ 159us) server_negotiation.cc:407] Connection header received
0923 14:41:29.658859 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:29.658862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:29.658907 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:29.658980 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:29.659483 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.660154 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.661037 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:29.661264 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:29.661343 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:29.664098 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:56573: BlockingRecv error: recv got EOF from 127.17.4.131:56573 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 23 14:41:30 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:30 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:30.331235 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:30.326051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:38917)
0923 14:41:30.326347 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:30.326361 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:30.326450 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:30.326725 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:30.326727 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:30.326934 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:30.327041 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:30.327047 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.327790 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.327792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:30.328461 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:30.328471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.328891 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.328894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:30.328960 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:30.329412 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:30.329423 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:30.331123 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":86,"threads_started":1}
W20260923 14:41:30.331382 26623 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:30.326156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:38917 (local address 127.17.4.190:42039)
0923 14:41:30.326406 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:30.326409 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:30.326422 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:41:30.326537 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:30.326540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:30.326583 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:30.326659 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:30.327142 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.327675 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.328572 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.328796 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.328887 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:30.331251 (+ 2364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:38917: BlockingRecv error: recv got EOF from 127.17.4.129:38917 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":63,"threads_started":1}
Sep 23 14:41:30 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:30 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:30.483194 26624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:30.477810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:36135)
0923 14:41:30.478064 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:30.478077 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:30.478169 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:30.478389 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:30.478391 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:30.478565 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:30.478659 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:30.478664 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.479461 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.479464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:30.480289 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:30.480302 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.480754 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.480758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:30.480826 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:30.481281 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:30.481292 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:30.483076 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":86,"threads_started":1}
W20260923 14:41:30.483348 26623 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:30.477955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:36135 (local address 127.17.4.190:42039)
0923 14:41:30.478083 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:30.478087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:30.478126 (+ 39us) server_negotiation.cc:407] Connection header received
0923 14:41:30.478248 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:30.478250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:30.478291 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:30.478360 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:30.478751 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.479348 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.480439 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.480654 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.480729 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:30.483209 (+ 2480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:36135: BlockingRecv error: recv got EOF from 127.17.4.130:36135 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 23 14:41:30 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:30 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:30.669867 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:30.664798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:38901)
0923 14:41:30.665042 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:30.665054 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:30.665145 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:30.665411 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:30.665413 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:30.665582 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:30.665713 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:30.665719 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.666430 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.666432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:30.666978 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:30.666985 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.667364 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.667367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:30.667425 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:30.667958 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:30.667969 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:30.669743 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":75,"threads_started":1}
W20260923 14:41:30.669987 26623 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:30.664830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:38901 (local address 127.17.4.190:42039)
0923 14:41:30.664943 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:30.664946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:30.665130 (+ 184us) server_negotiation.cc:407] Connection header received
0923 14:41:30.665205 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:30.665207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:30.665250 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:30.665338 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:30.665811 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.666294 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.667071 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:30.667272 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:30.667354 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:30.669864 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:38901: BlockingRecv error: recv got EOF from 127.17.4.131:38901 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 23 14:41:31 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:31 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:31.338075 26626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:31.332074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:59393)
0923 14:41:31.332340 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:31.332358 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:31.332476 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:31.332758 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:31.332761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:31.332961 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:31.333055 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:31.333060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.333876 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.333879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:31.334977 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:31.334989 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.335583 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.335585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:31.335645 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:31.336152 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:31.336163 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:31.337899 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":66,"threads_started":1}
W20260923 14:41:31.338171 26627 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:31.332199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:59393 (local address 127.17.4.190:42039)
0923 14:41:31.332521 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:31.332524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:31.332536 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:41:31.332571 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:31.332573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:31.332611 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:31.332689 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:31.333157 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.333773 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.335119 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.335491 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.335572 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:31.338037 (+ 2465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:59393: BlockingRecv error: recv got EOF from 127.17.4.129:59393 (error 108)
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":102,"threads_started":1}
Sep 23 14:41:31 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:31 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:31.489355 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:31.483971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:40751)
0923 14:41:31.484217 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:31.484232 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:31.484332 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:31.484556 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:31.484558 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:31.484732 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:31.484828 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:31.484832 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.485542 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.485544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:31.486110 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:31.486117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.486647 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.486652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:31.486749 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:31.487320 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:31.487331 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:31.489229 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
W20260923 14:41:31.489511 26627 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:31.484065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:40751 (local address 127.17.4.190:42039)
0923 14:41:31.484199 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:31.484202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:31.484302 (+ 100us) server_negotiation.cc:407] Connection header received
0923 14:41:31.484414 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:31.484416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:31.484461 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:31.484524 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:31.484920 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.485450 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.486206 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.486532 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.486616 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:31.489364 (+ 2748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:40751: BlockingRecv error: recv got EOF from 127.17.4.130:40751 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 23 14:41:31 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:31 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.131@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:31.675642 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:31.670573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.131:52021)
0923 14:41:31.670817 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:31.670830 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:31.670924 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:31.671140 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:31.671142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:31.671314 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:31.671409 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:31.671414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.672163 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.672165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:31.672700 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:31.672708 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.673186 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.673188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:31.673248 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:31.673767 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:31.673778 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:31.675499 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":94,"threads_started":1}
W20260923 14:41:31.675765 26627 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:31.670634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:52021 (local address 127.17.4.190:42039)
0923 14:41:31.670757 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:31.670760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:31.670891 (+ 131us) server_negotiation.cc:407] Connection header received
0923 14:41:31.671001 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:31.671003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:31.671046 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:31.671112 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:31.671497 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.672067 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.672811 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:31.673092 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:31.673173 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:31.675646 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.131:52021: BlockingRecv error: recv got EOF from 127.17.4.131:52021 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 23 14:41:32 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:32 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.129@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:32.344540 26630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:32.339110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.129:51093)
0923 14:41:32.339486 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:32.339501 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:32.339614 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:32.339961 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:32.339964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:32.340201 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:32.340321 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:32.340328 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.341085 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.341087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:32.341646 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:32.341653 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.342060 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.342062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:32.342136 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:32.342621 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:32.342631 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:32.344433 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":74,"threads_started":1}
W20260923 14:41:32.344717 26631 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:32.339222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:51093 (local address 127.17.4.190:42039)
0923 14:41:32.339490 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:32.339495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:32.339556 (+ 61us) server_negotiation.cc:407] Connection header received
0923 14:41:32.339738 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:32.339742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:32.339818 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:32.339915 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:32.340447 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.340988 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.341741 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.341971 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.342042 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:32.344556 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.129:51093: BlockingRecv error: recv got EOF from 127.17.4.129:51093 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":64,"threads_started":1}
Sep 23 14:41:32 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 14:41:32 dist-test-slave-54kg krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.4.130@KRBTEST.COM for oryx/127.17.4.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 14:41:32.495347 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:32.490182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:42039 (local address 127.17.4.130:33527)
0923 14:41:32.490466 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:32.490479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:32.490568 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:32.490786 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:32.490787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:32.490972 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:32.491065 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:32.491070 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.491784 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.491787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:32.492444 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:32.492453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.492889 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.492895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:32.492975 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:32.493431 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:32.493442 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:32.495198 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.4.190:42039: Server oryx/127.17.4.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":89,"threads_started":1}
W20260923 14:41:32.495401 26631 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:32.490255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:33527 (local address 127.17.4.190:42039)
0923 14:41:32.490394 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:32.490397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:32.490543 (+ 146us) server_negotiation.cc:407] Connection header received
0923 14:41:32.490642 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:32.490644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:32.490685 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:32.490754 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:32.491160 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.491669 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.492539 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.492743 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.492818 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:32.495314 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.4.130:33527: BlockingRecv error: recv got EOF from 127.17.4.130:33527 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:41:32.576839 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26155
I20260923 14:41:32.582031 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26307
I20260923 14:41:32.587172 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26440
I20260923 14:41:32.592270 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26085
2026-09-23T14:41:32Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17836 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-23T14:41:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:32Z Disabled control of system clock
I20260923 14:41:32.621217 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34235
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:34235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 14:41:32.725550 26636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:32.725757 26636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:32.725788 26636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:32.729717 26636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:32.729763 26636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:32.729777 26636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:32.729811 26636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:32.729868 26636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:32.734417 26636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:34235
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:32.735352 26636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:32.736624 26636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:32.744621 26644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:32.744776 26641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:32.744778 26642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:32.744953 26636 server_base.cc:1034] running on GCE node
I20260923 14:41:32.745502 26636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:32.746397 26636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:32.747552 26636 hybrid_clock.cc:648] HybridClock initialized: now 1790174492747516 us; error 47 us; skew 500 ppm
I20260923 14:41:32.749313 26636 webserver.cc:460] Webserver started at http://127.17.4.190:44963/ using document root <none> and password file <none>
I20260923 14:41:32.749778 26636 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:32.749833 26636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:32.749977 26636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:32.751670 26636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "68979f15ff644243a70075e9dbe49d65"
format_stamp: "Formatted at 2026-09-23 14:41:32 on dist-test-slave-54kg"
server_key: "342b5591bc5c34a93d887e83cf39d78b"
server_key_iv: "f7545e4d0bbe91ddc5b8a5cc12b29005"
server_key_version: "encryptionkey@0"
I20260923 14:41:32.752184 26636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "68979f15ff644243a70075e9dbe49d65"
format_stamp: "Formatted at 2026-09-23 14:41:32 on dist-test-slave-54kg"
server_key: "342b5591bc5c34a93d887e83cf39d78b"
server_key_iv: "f7545e4d0bbe91ddc5b8a5cc12b29005"
server_key_version: "encryptionkey@0"
I20260923 14:41:32.755331 26636 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:41:32.757532 26650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:32.758622 26636 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:41:32.758738 26636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "68979f15ff644243a70075e9dbe49d65"
format_stamp: "Formatted at 2026-09-23 14:41:32 on dist-test-slave-54kg"
server_key: "342b5591bc5c34a93d887e83cf39d78b"
server_key_iv: "f7545e4d0bbe91ddc5b8a5cc12b29005"
server_key_version: "encryptionkey@0"
I20260923 14:41:32.758841 26636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:32.784052 26636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:32.784730 26636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:32.784925 26636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:32.791602 26636 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:34235
I20260923 14:41:32.791615 26702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:34235 every 8 connection(s)
I20260923 14:41:32.792554 26636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:32.795593 26703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:32.796030 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26636
I20260923 14:41:32.796145 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:32.796428 17426 external_mini_cluster.cc:1428] Setting key 1e017fbb96761e8317a254a9e513fda1
I20260923 14:41:32.801263 26703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65: Bootstrap starting.
I20260923 14:41:32.803272 26703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:32.804075 26703 log.cc:824] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:32.805143 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:32.797766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47672 (local address 127.17.4.190:34235)
0923 14:41:32.798366 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:32.798380 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:32.798413 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:41:32.799037 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:32.799052 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:32.799403 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:32.799722 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:32.800125 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.801058 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.801953 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:32.802389 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:32.802565 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:32.803337 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:32.803342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:32.803353 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:32.803816 (+ 463us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:32.803881 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:32.803902 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:32.804020 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:32.804147 (+ 127us) server_negotiation.cc:299] Negotiation successful
0923 14:41:32.804394 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":127,"threads_started":1}
I20260923 14:41:32.805856 26703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65: No bootstrap required, opened a new log
I20260923 14:41:32.809126 26703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68979f15ff644243a70075e9dbe49d65" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34235 } }
I20260923 14:41:32.809360 26703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:32.809445 26703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68979f15ff644243a70075e9dbe49d65, State: Initialized, Role: FOLLOWER
I20260923 14:41:32.809890 26703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68979f15ff644243a70075e9dbe49d65" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34235 } }
I20260923 14:41:32.810038 26703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:32.810132 26703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:32.810230 26703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:32.811029 26703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68979f15ff644243a70075e9dbe49d65" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34235 } }
I20260923 14:41:32.811370 26703 leader_election.cc:302] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68979f15ff644243a70075e9dbe49d65; no voters:
I20260923 14:41:32.811669 26703 leader_election.cc:288] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:32.811748 26708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:32.812047 26708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [term 1 LEADER]: Becoming Leader. State: Replica: 68979f15ff644243a70075e9dbe49d65, State: Running, Role: LEADER
I20260923 14:41:32.812373 26708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68979f15ff644243a70075e9dbe49d65" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34235 } }
I20260923 14:41:32.812907 26703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:32.814062 26709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68979f15ff644243a70075e9dbe49d65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68979f15ff644243a70075e9dbe49d65" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34235 } } }
I20260923 14:41:32.814090 26710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68979f15ff644243a70075e9dbe49d65. Latest consensus state: current_term: 1 leader_uuid: "68979f15ff644243a70075e9dbe49d65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68979f15ff644243a70075e9dbe49d65" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34235 } } }
I20260923 14:41:32.814262 26709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:32.814266 26710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:32.815132 26718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:32.817539 26718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:32.822412 26718 catalog_manager.cc:1347] Generated new cluster ID: d29011f900994d989fcecc44bcfc3523
I20260923 14:41:32.822468 26718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:32.829052 26718 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:32.830080 26718 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:32.837544 26718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68979f15ff644243a70075e9dbe49d65: Generated new TSK 0
I20260923 14:41:32.838222 26718 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:41:32.841755 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34235
--builtin_ntp_servers=127.17.4.148:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260923 14:41:32.945447 26727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:32.945721 26727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:32.945792 26727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:32.949790 26727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:32.949855 26727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:32.949931 26727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:32.954284 26727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:32.955250 26727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:32.956655 26727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:41:32.965672 26727 server_base.cc:1034] running on GCE node
W20260923 14:41:32.965643 26735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:32.965741 26733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:32.965642 26732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:32.966290 26727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:32.966900 26727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:32.968078 26727 hybrid_clock.cc:648] HybridClock initialized: now 1790174492968065 us; error 25 us; skew 500 ppm
I20260923 14:41:32.969879 26727 webserver.cc:460] Webserver started at http://127.17.4.129:38397/ using document root <none> and password file <none>
I20260923 14:41:32.970424 26727 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:32.970512 26727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:32.970729 26727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:32.972685 26727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "298a9c9076174aaf80f50f5a7d87d8a2"
format_stamp: "Formatted at 2026-09-23 14:41:32 on dist-test-slave-54kg"
server_key: "6764fe45355d8a0e5f03eb33294ded48"
server_key_iv: "1158432595404023de2da72f313951b6"
server_key_version: "encryptionkey@0"
I20260923 14:41:32.973212 26727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "298a9c9076174aaf80f50f5a7d87d8a2"
format_stamp: "Formatted at 2026-09-23 14:41:32 on dist-test-slave-54kg"
server_key: "6764fe45355d8a0e5f03eb33294ded48"
server_key_iv: "1158432595404023de2da72f313951b6"
server_key_version: "encryptionkey@0"
I20260923 14:41:32.976599 26727 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:41:32.978820 26741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:32.979969 26727 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:32.980093 26727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "298a9c9076174aaf80f50f5a7d87d8a2"
format_stamp: "Formatted at 2026-09-23 14:41:32 on dist-test-slave-54kg"
server_key: "6764fe45355d8a0e5f03eb33294ded48"
server_key_iv: "1158432595404023de2da72f313951b6"
server_key_version: "encryptionkey@0"
I20260923 14:41:32.980213 26727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:32.992662 26727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:32.993242 26727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:32.993433 26727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:32.993932 26727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:32.994796 26727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:32.994882 26727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:32.994949 26727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:32.994992 26727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.003310 26727 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:46331
I20260923 14:41:33.003336 26854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:46331 every 8 connection(s)
I20260923 14:41:33.004165 26727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:33.007169 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26727
I20260923 14:41:33.007251 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:33.007551 17426 external_mini_cluster.cc:1428] Setting key 4d4ed46f1f77a0247529c1190367c762
I20260923 14:41:33.009554 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34235
--builtin_ntp_servers=127.17.4.148:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 14:41:33.013785 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.005793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:33243 (local address 127.17.4.190:34235)
0923 14:41:33.005916 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.005920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.006968 (+ 1048us) server_negotiation.cc:407] Connection header received
0923 14:41:33.008658 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.008661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.008703 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.008772 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.009674 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.010545 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.011684 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.011981 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.012094 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:33.013285 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:33.013289 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:33.013291 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:33.013303 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:33.013326 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:33.013342 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:33.013417 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:33.013587 (+ 170us) server_negotiation.cc:299] Negotiation successful
0923 14:41:33.013648 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:41:33.014779 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.006201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34235 (local address 127.17.4.129:33243)
0923 14:41:33.006809 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:33.006846 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:33.008449 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:33.008932 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:33.008940 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:33.009051 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:33.009535 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:33.009547 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.010668 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.010671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:33.011556 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:33.011565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.012126 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.012130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:33.012291 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:33.012916 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:33.012917 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:33.012955 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:33.013019 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:33.013442 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:33.013452 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:33.013457 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 14:41:33.013586 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 14:41:33.013843 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":106,"threads_started":1}
I20260923 14:41:33.015976 26855 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34235
I20260923 14:41:33.016237 26855 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:33.016875 26855 heartbeater.cc:511] Master 127.17.4.190:34235 requested a full tablet report, sending...
I20260923 14:41:33.018656 26667 ts_manager.cc:194] Registered new tserver with Master: 298a9c9076174aaf80f50f5a7d87d8a2 (127.17.4.129:46331)
I20260923 14:41:33.019730 26667 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.129:33243
W20260923 14:41:33.118057 26858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:33.118268 26858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:33.118326 26858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:33.122083 26858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:33.122124 26858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:33.122171 26858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:33.126673 26858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:33.127566 26858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:33.128825 26858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:33.138119 26863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:33.138141 26866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.138180 26858 server_base.cc:1034] running on GCE node
W20260923 14:41:33.138119 26864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.138990 26858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:33.139575 26858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:33.140755 26858 hybrid_clock.cc:648] HybridClock initialized: now 1790174493140721 us; error 44 us; skew 500 ppm
I20260923 14:41:33.142627 26858 webserver.cc:460] Webserver started at http://127.17.4.130:42451/ using document root <none> and password file <none>
I20260923 14:41:33.143157 26858 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:33.143244 26858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:33.143481 26858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:33.145382 26858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "a52be2c1c5784e62b2c7454d0c595fe9"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "2afd4d3de076a89988763dac3a658ec7"
server_key_iv: "3481a3f2ebc9b621b072d817ae1c49ef"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.145897 26858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "a52be2c1c5784e62b2c7454d0c595fe9"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "2afd4d3de076a89988763dac3a658ec7"
server_key_iv: "3481a3f2ebc9b621b072d817ae1c49ef"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.149274 26858 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260923 14:41:33.151408 26872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.152540 26858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:41:33.152667 26858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "a52be2c1c5784e62b2c7454d0c595fe9"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "2afd4d3de076a89988763dac3a658ec7"
server_key_iv: "3481a3f2ebc9b621b072d817ae1c49ef"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.152771 26858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:33.173204 26858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:33.173810 26858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:33.173997 26858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:33.174582 26858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:33.175442 26858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:33.175511 26858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.175580 26858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:33.175622 26858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.183894 26858 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:36659
I20260923 14:41:33.183945 26985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:36659 every 8 connection(s)
I20260923 14:41:33.184734 26858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:33.185452 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26858
I20260923 14:41:33.185575 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:33.185870 17426 external_mini_cluster.cc:1428] Setting key 00d76717ca5c82b3a25c1786104fa4ed
I20260923 14:41:33.188001 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34235
--builtin_ntp_servers=127.17.4.148:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 14:41:33.194553 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.186797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:56251 (local address 127.17.4.190:34235)
0923 14:41:33.186938 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.186943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.188013 (+ 1070us) server_negotiation.cc:407] Connection header received
0923 14:41:33.189973 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.189977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.190028 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.190135 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.190981 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.191501 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.192684 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.192906 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.193034 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:33.194072 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:33.194083 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:33.194085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:33.194096 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:33.194114 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:33.194122 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:33.194197 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:33.194356 (+ 159us) server_negotiation.cc:299] Negotiation successful
0923 14:41:33.194413 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:41:33.195319 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.187040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34235 (local address 127.17.4.130:56251)
0923 14:41:33.187834 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:33.187889 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:33.189773 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:33.190304 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:33.190311 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:33.190390 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:33.190838 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:33.190850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.191624 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.191627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:33.192560 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:33.192570 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.193068 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.193072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:33.193226 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:33.193820 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:33.193821 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:33.193859 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:33.193916 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:33.194197 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:33.194208 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:33.194216 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 14:41:33.194342 (+ 126us) client_negotiation.cc:240] Negotiation successful
0923 14:41:33.194606 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":121,"threads_started":1}
I20260923 14:41:33.196614 26986 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34235
I20260923 14:41:33.196830 26986 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:33.197304 26986 heartbeater.cc:511] Master 127.17.4.190:34235 requested a full tablet report, sending...
I20260923 14:41:33.198336 26667 ts_manager.cc:194] Registered new tserver with Master: a52be2c1c5784e62b2c7454d0c595fe9 (127.17.4.130:36659)
I20260923 14:41:33.199059 26667 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.130:56251
W20260923 14:41:33.294239 26989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:33.294473 26989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:33.294524 26989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:33.298343 26989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:33.298385 26989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:33.298434 26989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:33.302793 26989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:33.303650 26989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:33.304942 26989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:33.313941 26995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:33.313889 26994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.314145 26989 server_base.cc:1034] running on GCE node
W20260923 14:41:33.313902 26997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.314630 26989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:33.315326 26989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:33.316501 26989 hybrid_clock.cc:648] HybridClock initialized: now 1790174493316483 us; error 34 us; skew 500 ppm
I20260923 14:41:33.323956 26989 webserver.cc:460] Webserver started at http://127.17.4.131:42487/ using document root <none> and password file <none>
I20260923 14:41:33.324479 26989 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:33.324534 26989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:33.324684 26989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:33.326553 26989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "0e58e9aeb957448ca460ae41efabab82"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "9d16ce4665cbb5ea1369fcd924990d50"
server_key_iv: "08ce7e78d31e540b69b1ad035e5f5548"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.327044 26989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "0e58e9aeb957448ca460ae41efabab82"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "9d16ce4665cbb5ea1369fcd924990d50"
server_key_iv: "08ce7e78d31e540b69b1ad035e5f5548"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.330375 26989 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 14:41:33.332629 27003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.333755 26989 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:33.333869 26989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "0e58e9aeb957448ca460ae41efabab82"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "9d16ce4665cbb5ea1369fcd924990d50"
server_key_iv: "08ce7e78d31e540b69b1ad035e5f5548"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.333966 26989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:33.356462 26989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:33.357064 26989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:33.357241 26989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:33.357775 26989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:33.358625 26989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:33.358670 26989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.358734 26989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:33.358771 26989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.367337 26989 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:35277
I20260923 14:41:33.367355 27116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:35277 every 8 connection(s)
I20260923 14:41:33.368274 26989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:33.374351 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 26989
I20260923 14:41:33.374451 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:33.374693 17426 external_mini_cluster.cc:1428] Setting key b73ce46c4fe19fc03943d6f30eb3277a
I20260923 14:41:33.377355 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.370162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:33019 (local address 127.17.4.190:34235)
0923 14:41:33.370313 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.370318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.371273 (+ 955us) server_negotiation.cc:407] Connection header received
0923 14:41:33.372645 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.372647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.372693 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.372762 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.373597 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.374132 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.375314 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.375638 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.375754 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:33.376948 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:33.376951 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:33.376954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:33.376966 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:33.376995 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:33.377003 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:33.377059 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:33.377191 (+ 132us) server_negotiation.cc:299] Negotiation successful
0923 14:41:33.377236 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 14:41:33.378149 27119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.370541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34235 (local address 127.17.4.131:33019)
0923 14:41:33.371131 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:33.371166 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:33.372470 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:33.372908 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:33.372913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:33.373009 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:33.373480 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:33.373491 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.374256 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.374258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:33.375185 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:33.375194 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:33.375853 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:33.375859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:33.376078 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:33.376651 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:33.376655 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:33.376725 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:33.376799 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:33.377075 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:33.377081 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:33.377085 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:41:33.377171 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:41:33.377388 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":97,"threads_started":1}
I20260923 14:41:33.379140 27117 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34235
I20260923 14:41:33.379364 27117 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:33.379906 27117 heartbeater.cc:511] Master 127.17.4.190:34235 requested a full tablet report, sending...
I20260923 14:41:33.380784 26667 ts_manager.cc:194] Registered new tserver with Master: 0e58e9aeb957448ca460ae41efabab82 (127.17.4.131:35277)
I20260923 14:41:33.381300 26667 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.131:33019
I20260923 14:41:33.388302 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 14:41:33.390869 26706 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:33.390039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47686 (local address 127.17.4.190:34235)
0923 14:41:33.390185 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.390189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.390348 (+ 159us) server_negotiation.cc:407] Connection header received
0923 14:41:33.390417 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.390419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.390455 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.390510 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.390734 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47686: BlockingRecv error: recv got EOF from 127.0.0.1:47686 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 14:41:33.390950 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26727
I20260923 14:41:33.395939 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26858
I20260923 14:41:33.401028 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26989
I20260923 14:41:33.405691 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 26636
2026-09-23T14:41:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (811 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-23T14:41:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:33Z Disabled control of system clock
I20260923 14:41:33.432775 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:38127
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:38127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 14:41:33.536916 27128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:33.537147 27128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:33.537182 27128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:33.541083 27128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:33.541133 27128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:33.541149 27128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:33.541165 27128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:33.541180 27128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:33.545688 27128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:38127
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:38127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:33.546535 27128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:33.547739 27128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:33.555634 27133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:33.555625 27136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:33.555624 27134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.555997 27128 server_base.cc:1034] running on GCE node
I20260923 14:41:33.556543 27128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:33.557575 27128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:33.558758 27128 hybrid_clock.cc:648] HybridClock initialized: now 1790174493558742 us; error 30 us; skew 500 ppm
I20260923 14:41:33.560492 27128 webserver.cc:460] Webserver started at http://127.17.4.190:40989/ using document root <none> and password file <none>
I20260923 14:41:33.561033 27128 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:33.561120 27128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:33.561333 27128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:33.563205 27128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "a90dc1b334c64ff88321a59709506db6"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "ba8285e816db3f5463c7b7661ac39399"
server_key_iv: "5acc6497eb47c7ddb5f208058d1eef7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.563745 27128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "a90dc1b334c64ff88321a59709506db6"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "ba8285e816db3f5463c7b7661ac39399"
server_key_iv: "5acc6497eb47c7ddb5f208058d1eef7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.567165 27128 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:41:33.569401 27142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.570475 27128 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:33.570603 27128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "a90dc1b334c64ff88321a59709506db6"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "ba8285e816db3f5463c7b7661ac39399"
server_key_iv: "5acc6497eb47c7ddb5f208058d1eef7d"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.570708 27128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:33.574915 27128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:33.575453 27128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:33.575623 27128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:33.581959 27128 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:38127
I20260923 14:41:33.582000 27194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:38127 every 8 connection(s)
I20260923 14:41:33.582813 27128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:33.585704 27195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:33.587440 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27128
I20260923 14:41:33.587527 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:33.587860 17426 external_mini_cluster.cc:1428] Setting key 90a8afc23cf1157e49ed9d4c30e9b9b3
I20260923 14:41:33.591243 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6: Bootstrap starting.
I20260923 14:41:33.593161 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.589225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.17.4.190:38127)
0923 14:41:33.589798 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.589812 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.589843 (+ 31us) server_negotiation.cc:407] Connection header received
0923 14:41:33.590623 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.590641 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.590964 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.591270 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.592031 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:33.592045 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:33.592057 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:33.592066 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:33.592115 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:33.592130 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:33.592274 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:33.592340 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 14:41:33.592568 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":119,"threads_started":1}
I20260923 14:41:33.593575 27195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:33.594341 27195 log.cc:824] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:33.596199 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6: No bootstrap required, opened a new log
I20260923 14:41:33.599738 27195 raft_consensus.cc:348] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90dc1b334c64ff88321a59709506db6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38127 } }
I20260923 14:41:33.599992 27195 raft_consensus.cc:374] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:33.600034 27195 raft_consensus.cc:729] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a90dc1b334c64ff88321a59709506db6, State: Initialized, Role: FOLLOWER
I20260923 14:41:33.600363 27195 consensus_queue.cc:260] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90dc1b334c64ff88321a59709506db6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38127 } }
I20260923 14:41:33.600473 27195 raft_consensus.cc:388] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:33.600513 27195 raft_consensus.cc:482] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:33.600576 27195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:33.601339 27195 raft_consensus.cc:504] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90dc1b334c64ff88321a59709506db6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38127 } }
I20260923 14:41:33.601608 27195 leader_election.cc:302] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a90dc1b334c64ff88321a59709506db6; no voters:
I20260923 14:41:33.601818 27195 leader_election.cc:288] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:33.601941 27200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:33.602195 27200 raft_consensus.cc:686] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [term 1 LEADER]: Becoming Leader. State: Replica: a90dc1b334c64ff88321a59709506db6, State: Running, Role: LEADER
I20260923 14:41:33.602516 27200 consensus_queue.cc:237] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90dc1b334c64ff88321a59709506db6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38127 } }
I20260923 14:41:33.603052 27195 sys_catalog.cc:564] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:33.604136 27202 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a90dc1b334c64ff88321a59709506db6. Latest consensus state: current_term: 1 leader_uuid: "a90dc1b334c64ff88321a59709506db6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90dc1b334c64ff88321a59709506db6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38127 } } }
I20260923 14:41:33.604264 27202 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:33.604625 27209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:33.604605 27201 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a90dc1b334c64ff88321a59709506db6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90dc1b334c64ff88321a59709506db6" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 38127 } } }
I20260923 14:41:33.605356 27201 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6 [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:33.607573 27209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:33.612696 27209 catalog_manager.cc:1347] Generated new cluster ID: edf90a588b174033bfb7a33690dc2353
I20260923 14:41:33.612752 27209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:33.624770 27209 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:33.625111 27209 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:33.638748 27209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a90dc1b334c64ff88321a59709506db6: Generated new TSK 0
I20260923 14:41:33.639540 27209 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:41:33.643322 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:38127
--builtin_ntp_servers=127.17.4.148:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 14:41:33.764971 27219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:33.765209 27219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:33.765270 27219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:33.769155 27219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:33.769220 27219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:33.769301 27219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:33.773823 27219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:38127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:33.774840 27219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:33.776110 27219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:33.785328 27227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:33.785365 27225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.785497 27219 server_base.cc:1034] running on GCE node
W20260923 14:41:33.785382 27224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.786110 27219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:33.786708 27219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:33.787899 27219 hybrid_clock.cc:648] HybridClock initialized: now 1790174493787888 us; error 25 us; skew 500 ppm
I20260923 14:41:33.789629 27219 webserver.cc:460] Webserver started at http://127.17.4.129:40253/ using document root <none> and password file <none>
I20260923 14:41:33.790201 27219 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:33.790287 27219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:33.790513 27219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:33.792655 27219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "3bdde9f6ecbc453a97f4bcfff1d041df"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "a0c8382319e301d30aa0c7763152df90"
server_key_iv: "d334de899acf723ab4140b45b15d4abe"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.793181 27219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "3bdde9f6ecbc453a97f4bcfff1d041df"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "a0c8382319e301d30aa0c7763152df90"
server_key_iv: "d334de899acf723ab4140b45b15d4abe"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.796671 27219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260923 14:41:33.798995 27233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.800110 27219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:41:33.800227 27219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "3bdde9f6ecbc453a97f4bcfff1d041df"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "a0c8382319e301d30aa0c7763152df90"
server_key_iv: "d334de899acf723ab4140b45b15d4abe"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.800329 27219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:33.804836 27219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:33.805404 27219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:33.805586 27219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:33.806077 27219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:33.806936 27219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:33.807001 27219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.807065 27219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:33.807109 27219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.815330 27219 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:43331
I20260923 14:41:33.815351 27346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:43331 every 8 connection(s)
I20260923 14:41:33.816149 27219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:33.820008 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27219
I20260923 14:41:33.820118 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:33.820508 17426 external_mini_cluster.cc:1428] Setting key 8ae2120933c92bf9208aed5c1b78f5ba
I20260923 14:41:33.822108 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.817818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:47863 (local address 127.17.4.190:38127)
0923 14:41:33.817971 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.817976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.819021 (+ 1045us) server_negotiation.cc:407] Connection header received
0923 14:41:33.820395 (+ 1374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.820398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.820459 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.820556 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.821648 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:33.821651 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:33.821654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:33.821666 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:33.821687 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:33.821703 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:33.821796 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:33.821938 (+ 142us) server_negotiation.cc:299] Negotiation successful
0923 14:41:33.821983 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:41:33.822333 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:38127
--builtin_ntp_servers=127.17.4.148:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260923 14:41:33.822966 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.818242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:38127 (local address 127.17.4.129:47863)
0923 14:41:33.818859 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:33.818924 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:33.820190 (+ 1266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:33.820741 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:33.820747 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:33.820831 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:33.821407 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:33.821408 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:33.821446 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:33.821509 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:33.821784 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:33.821793 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:33.821798 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 14:41:33.821979 (+ 181us) client_negotiation.cc:240] Negotiation successful
0923 14:41:33.822199 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260923 14:41:33.824129 27347 heartbeater.cc:347] Connected to a master server at 127.17.4.190:38127
I20260923 14:41:33.824337 27347 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:33.824689 27347 heartbeater.cc:511] Master 127.17.4.190:38127 requested a full tablet report, sending...
I20260923 14:41:33.826037 27159 ts_manager.cc:194] Registered new tserver with Master: 3bdde9f6ecbc453a97f4bcfff1d041df (127.17.4.129:43331)
W20260923 14:41:33.927834 27350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:33.928097 27350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:33.928164 27350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:33.932067 27350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:33.932140 27350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:33.932225 27350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:33.936932 27350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:38127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:33.938035 27350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:33.939384 27350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:33.948431 27358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.948688 27350 server_base.cc:1034] running on GCE node
W20260923 14:41:33.948844 27355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:33.948895 27356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:33.949326 27350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:33.949908 27350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:33.951084 27350 hybrid_clock.cc:648] HybridClock initialized: now 1790174493951067 us; error 28 us; skew 500 ppm
I20260923 14:41:33.952844 27350 webserver.cc:460] Webserver started at http://127.17.4.130:44321/ using document root <none> and password file <none>
I20260923 14:41:33.953397 27350 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:33.953490 27350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:33.953714 27350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:33.955675 27350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "da1a1494a4ad43feb12309542998e0b8"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "814a521b48f2bd06c02974e3040a1011"
server_key_iv: "7abe489370d265b700d6479a48ff90de"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.956261 27350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "da1a1494a4ad43feb12309542998e0b8"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "814a521b48f2bd06c02974e3040a1011"
server_key_iv: "7abe489370d265b700d6479a48ff90de"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.959666 27350 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:41:33.961956 27364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.963044 27350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:33.963165 27350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "da1a1494a4ad43feb12309542998e0b8"
format_stamp: "Formatted at 2026-09-23 14:41:33 on dist-test-slave-54kg"
server_key: "814a521b48f2bd06c02974e3040a1011"
server_key_iv: "7abe489370d265b700d6479a48ff90de"
server_key_version: "encryptionkey@0"
I20260923 14:41:33.963266 27350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:33.967546 27350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:33.968137 27350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:33.968309 27350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:33.968837 27350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:33.969672 27350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:33.969741 27350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.969805 27350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:33.969854 27350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:33.978350 27350 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:42231
I20260923 14:41:33.978379 27477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:42231 every 8 connection(s)
I20260923 14:41:33.979142 27350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:33.985039 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.980807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:54291 (local address 127.17.4.190:38127)
0923 14:41:33.980941 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:33.980945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:33.982027 (+ 1082us) server_negotiation.cc:407] Connection header received
0923 14:41:33.983325 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:33.983327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:33.983380 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:33.983493 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:33.984569 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:33.984572 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:33.984575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:33.984586 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:33.984607 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:33.984623 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:33.984716 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:33.984846 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 14:41:33.984911 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:41:33.986088 27480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:33.981151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:38127 (local address 127.17.4.130:54291)
0923 14:41:33.981884 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:33.981932 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:33.983122 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:33.983645 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:33.983652 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:33.983731 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:33.984330 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:33.984332 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:33.984369 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:33.984432 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:33.984703 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:33.984710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:33.984715 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 14:41:33.984893 (+ 178us) client_negotiation.cc:240] Negotiation successful
0923 14:41:33.985103 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":103,"threads_started":1}
I20260923 14:41:33.987187 27478 heartbeater.cc:347] Connected to a master server at 127.17.4.190:38127
I20260923 14:41:33.987380 27478 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:33.987704 27478 heartbeater.cc:511] Master 127.17.4.190:38127 requested a full tablet report, sending...
I20260923 14:41:33.988227 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27350
I20260923 14:41:33.988360 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:33.988705 17426 external_mini_cluster.cc:1428] Setting key ab60783162d8972cea035ec92e203a3b
I20260923 14:41:33.988843 27159 ts_manager.cc:194] Registered new tserver with Master: da1a1494a4ad43feb12309542998e0b8 (127.17.4.130:42231)
I20260923 14:41:33.990625 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:38127
--builtin_ntp_servers=127.17.4.148:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 14:41:34.095693 27481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:34.095974 27481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:34.096032 27481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:34.099912 27481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:34.099962 27481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:34.100046 27481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:34.104800 27481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:38127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:34.105772 27481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:34.107190 27481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:34.116539 27489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:34.116539 27487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:34.116526 27486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:34.116719 27481 server_base.cc:1034] running on GCE node
I20260923 14:41:34.117184 27481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:34.117734 27481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:34.118919 27481 hybrid_clock.cc:648] HybridClock initialized: now 1790174494118904 us; error 26 us; skew 500 ppm
I20260923 14:41:34.120712 27481 webserver.cc:460] Webserver started at http://127.17.4.131:40033/ using document root <none> and password file <none>
I20260923 14:41:34.121268 27481 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:34.121359 27481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:34.121593 27481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:34.123528 27481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "145519a2e52d435b8a685fe27b814db0"
format_stamp: "Formatted at 2026-09-23 14:41:34 on dist-test-slave-54kg"
server_key: "4a68247d70de153d4aace5a3ef070dcc"
server_key_iv: "7fb6f7e7ea3680fb8eec7db5fba684ac"
server_key_version: "encryptionkey@0"
I20260923 14:41:34.124127 27481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "145519a2e52d435b8a685fe27b814db0"
format_stamp: "Formatted at 2026-09-23 14:41:34 on dist-test-slave-54kg"
server_key: "4a68247d70de153d4aace5a3ef070dcc"
server_key_iv: "7fb6f7e7ea3680fb8eec7db5fba684ac"
server_key_version: "encryptionkey@0"
I20260923 14:41:34.127641 27481 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:41:34.129974 27495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:34.131093 27481 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:34.131217 27481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "145519a2e52d435b8a685fe27b814db0"
format_stamp: "Formatted at 2026-09-23 14:41:34 on dist-test-slave-54kg"
server_key: "4a68247d70de153d4aace5a3ef070dcc"
server_key_iv: "7fb6f7e7ea3680fb8eec7db5fba684ac"
server_key_version: "encryptionkey@0"
I20260923 14:41:34.131325 27481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:34.135691 27481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:34.136248 27481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:34.136435 27481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:34.136945 27481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:34.137784 27481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:34.137850 27481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:34.137909 27481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:34.137961 27481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:34.146157 27481 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:41775
I20260923 14:41:34.146190 27608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:41775 every 8 connection(s)
I20260923 14:41:34.146965 27481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:34.152496 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:34.148688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:35059 (local address 127.17.4.190:38127)
0923 14:41:34.148829 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:34.148833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:34.149763 (+ 930us) server_negotiation.cc:407] Connection header received
0923 14:41:34.150981 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:34.150984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:34.151021 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:34.151092 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:34.152125 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:34.152129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:34.152131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:41:34.152141 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:34.152160 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:41:34.152168 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:34.152242 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:34.152363 (+ 121us) server_negotiation.cc:299] Negotiation successful
0923 14:41:34.152397 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:41:34.153313 27611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:34.149029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:38127 (local address 127.17.4.131:35059)
0923 14:41:34.149625 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:34.149662 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:34.150795 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:34.151245 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:34.151251 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:34.151333 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:34.151885 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:41:34.151887 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:34.151923 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:41:34.151985 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:34.152241 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:34.152247 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:34.152250 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 14:41:34.152383 (+ 133us) client_negotiation.cc:240] Negotiation successful
0923 14:41:34.152578 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":103,"threads_started":1}
I20260923 14:41:34.154392 27609 heartbeater.cc:347] Connected to a master server at 127.17.4.190:38127
I20260923 14:41:34.154603 27609 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:34.154964 27609 heartbeater.cc:511] Master 127.17.4.190:38127 requested a full tablet report, sending...
I20260923 14:41:34.155947 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27481
I20260923 14:41:34.155946 27159 ts_manager.cc:194] Registered new tserver with Master: 145519a2e52d435b8a685fe27b814db0 (127.17.4.131:41775)
I20260923 14:41:34.156044 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:34.156349 17426 external_mini_cluster.cc:1428] Setting key 60420e575af43f176086cf89c52d27e6
I20260923 14:41:34.158396 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 14:41:34.161149 27198 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:41:34.160253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.17.4.190:38127)
0923 14:41:34.160396 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:34.160400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:34.160580 (+ 180us) server_negotiation.cc:407] Connection header received
0923 14:41:34.160721 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:34.160724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:34.160755 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:34.160843 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:34.161046 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34996: BlockingRecv error: recv got EOF from 127.0.0.1:34996 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:41:34.161369 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27219
I20260923 14:41:34.166765 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27350
I20260923 14:41:34.172443 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27481
I20260923 14:41:34.177641 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27128
2026-09-23T14:41:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (772 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:34 dist-test-slave-54kg krb5kdc[27619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:34 dist-test-slave-54kg krb5kdc[27619](info): set up 2 sockets
Sep 23 14:41:34 dist-test-slave-54kg krb5kdc[27619](info): commencing operation
krb5kdc: starting...
W20260923 14:41:35.198012 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.000s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:41:35.314059 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39769
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:35.418123 27632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:35.418385 27632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:35.418457 27632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:35.422430 27632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:41:35.422505 27632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:35.422541 27632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:35.422595 27632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:41:35.422633 27632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:41:35.427675 27632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:35.428637 27632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:35.429589 27632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:35.437803 27638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:35.437829 27637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:35.437930 27632 server_base.cc:1034] running on GCE node
W20260923 14:41:35.437801 27640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:35.438668 27632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:35.439647 27632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:35.440798 27632 hybrid_clock.cc:648] HybridClock initialized: now 1790174495440762 us; error 49 us; skew 500 ppm
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:35.443380 27632 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:41:35.444209 27632 webserver.cc:460] Webserver started at http://127.17.4.190:45983/ using document root <none> and password file <none>
I20260923 14:41:35.444680 27632 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:35.444734 27632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:35.444885 27632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:35.446735 27632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "1ba8f227325f4a8d926e935ebe9a0a6f"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "676e4368b592e4e967806082d7e65e2d"
server_key_iv: "8394607957b15ce5ac27185a6c5fdc25"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.447223 27632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "1ba8f227325f4a8d926e935ebe9a0a6f"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "676e4368b592e4e967806082d7e65e2d"
server_key_iv: "8394607957b15ce5ac27185a6c5fdc25"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.450590 27632 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:41:35.452790 27647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.453890 27632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:41:35.454030 27632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "1ba8f227325f4a8d926e935ebe9a0a6f"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "676e4368b592e4e967806082d7e65e2d"
server_key_iv: "8394607957b15ce5ac27185a6c5fdc25"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.454124 27632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:35.471580 27632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:35.474216 27632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:35.474400 27632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:35.480896 27632 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:39769
I20260923 14:41:35.481196 27699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:39769 every 8 connection(s)
I20260923 14:41:35.481791 27632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:41:35.484336 27700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:35.489176 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27632
I20260923 14:41:35.489295 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:41:35.489573 17426 external_mini_cluster.cc:1428] Setting key 4d4469429fb8cec34daa4aa8fdcc7407
I20260923 14:41:35.489637 27700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f: Bootstrap starting.
I20260923 14:41:35.492404 27700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:35.493260 27700 log.cc:824] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:35.495420 27700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f: No bootstrap required, opened a new log
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:35.499437 27700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39769 } }
I20260923 14:41:35.499732 27700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:35.499818 27700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba8f227325f4a8d926e935ebe9a0a6f, State: Initialized, Role: FOLLOWER
I20260923 14:41:35.500334 27700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39769 } }
I20260923 14:41:35.500505 27700 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:41:35.500574 27700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:41:35.500663 27700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:35.501725 27700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39769 } }
I20260923 14:41:35.502084 27700 leader_election.cc:302] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ba8f227325f4a8d926e935ebe9a0a6f; no voters:
I20260923 14:41:35.502401 27700 leader_election.cc:288] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:41:35.502496 27705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:35.502781 27705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [term 1 LEADER]: Becoming Leader. State: Replica: 1ba8f227325f4a8d926e935ebe9a0a6f, State: Running, Role: LEADER
I20260923 14:41:35.503154 27705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39769 } }
I20260923 14:41:35.503810 27700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:41:35.504101 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:35.490806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57818 (local address 127.17.4.190:39769)
0923 14:41:35.491210 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:35.491228 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:35.491268 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:41:35.492070 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:35.492093 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:35.492519 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:35.492877 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:35.493607 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.495020 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.495942 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.496590 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.496773 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:35.499089 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:35.499095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:35.499110 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:35.499138 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:35.501085 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:35.501466 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:35.501471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:35.501477 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:35.501623 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:35.501880 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:35.501883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:35.501884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:35.502394 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:35.502589 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:35.502895 (+ 306us) server_negotiation.cc:299] Negotiation successful
0923 14:41:35.503182 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":115,"threads_started":1}
I20260923 14:41:35.504256 27705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ba8f227325f4a8d926e935ebe9a0a6f. Latest consensus state: current_term: 1 leader_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39769 } } }
I20260923 14:41:35.504458 27705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:35.504256 27706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ba8f227325f4a8d926e935ebe9a0a6f" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39769 } } }
I20260923 14:41:35.504720 27706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f [sys.catalog]: This master's current role is: LEADER
I20260923 14:41:35.505024 27709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:41:35.508296 27709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:41:35.513288 27709 catalog_manager.cc:1347] Generated new cluster ID: 2e4caadf50664329a463eeb5934b4018
I20260923 14:41:35.513345 27709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:41:35.538197 27709 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:41:35.539407 27709 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:41:35.544412 27709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f: Generated new TSK 0
I20260923 14:41:35.545154 27709 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:41:35.582485 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39769
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:35.695909 27726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:35.696178 27726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:35.696252 27726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:35.700423 27726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:35.700500 27726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:35.700585 27726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:41:35.705904 27726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:35.706892 27726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:35.707887 27726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:35.717000 27731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:35.716992 27732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:35.717036 27726 server_base.cc:1034] running on GCE node
W20260923 14:41:35.716992 27734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:35.717612 27726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:35.718182 27726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:35.719342 27726 hybrid_clock.cc:648] HybridClock initialized: now 1790174495719323 us; error 32 us; skew 500 ppm
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:35.721930 27726 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:41:35.722803 27726 webserver.cc:460] Webserver started at http://127.17.4.129:34729/ using document root <none> and password file <none>
I20260923 14:41:35.723333 27726 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:35.723392 27726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:35.723621 27726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:35.725644 27726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "34cfacde69964cc6a3c80cd1ce72ef90"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "6a04784e1c9265177b31700a66967773"
server_key_iv: "9f5a5ce8891d4e41ce3875e97a7c2fde"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.726202 27726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "34cfacde69964cc6a3c80cd1ce72ef90"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "6a04784e1c9265177b31700a66967773"
server_key_iv: "9f5a5ce8891d4e41ce3875e97a7c2fde"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.729787 27726 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:41:35.732081 27741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.733408 27726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:41:35.733569 27726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "34cfacde69964cc6a3c80cd1ce72ef90"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "6a04784e1c9265177b31700a66967773"
server_key_iv: "9f5a5ce8891d4e41ce3875e97a7c2fde"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.733678 27726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:35.746876 27726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:35.749698 27726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:35.749890 27726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:35.750445 27726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:35.751276 27726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:35.751348 27726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.751423 27726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:35.751466 27726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.760622 27726 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:38239
I20260923 14:41:35.760658 27854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:38239 every 8 connection(s)
I20260923 14:41:35.761473 27726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:41:35.768510 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27726
I20260923 14:41:35.768656 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:41:35.768967 17426 external_mini_cluster.cc:1428] Setting key 402e526436b84f3d511b5a204cbc5d59
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:35.774547 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:35.763075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:38979 (local address 127.17.4.190:39769)
0923 14:41:35.763226 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:35.763230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:35.764096 (+ 866us) server_negotiation.cc:407] Connection header received
0923 14:41:35.765376 (+ 1280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:35.765379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:35.765425 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:35.765495 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:35.766573 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.767108 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.768360 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.768574 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.768711 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:35.771208 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:35.771211 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:35.771213 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:35.771234 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:35.772664 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:35.773152 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:35.773157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:35.773159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:35.773236 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:35.773558 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:35.773563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:35.773565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:35.773729 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:35.773832 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:35.774270 (+ 438us) server_negotiation.cc:299] Negotiation successful
0923 14:41:35.774384 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 14:41:35.775354 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:35.763455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39769 (local address 127.17.4.129:38979)
0923 14:41:35.763956 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:35.763998 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:35.765185 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:35.765653 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:35.765660 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:35.765984 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:35.766448 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:35.766462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.767211 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.767213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:35.768213 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:35.768223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.768736 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.768741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:35.768938 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:35.769508 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:35.769523 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:35.771050 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:35.772791 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:35.772797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:35.772809 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:35.773051 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:35.773324 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:35.773328 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:35.773330 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:35.773467 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:35.773830 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:35.773835 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:35.774055 (+ 220us) client_negotiation.cc:769] Sending connection context
0923 14:41:35.774230 (+ 175us) client_negotiation.cc:240] Negotiation successful
0923 14:41:35.774526 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":106,"threads_started":1}
I20260923 14:41:35.776629 27855 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39769
I20260923 14:41:35.776875 27855 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:35.777339 27855 heartbeater.cc:511] Master 127.17.4.190:39769 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:41:35.778869 27664 ts_manager.cc:194] Registered new tserver with Master: 34cfacde69964cc6a3c80cd1ce72ef90 (127.17.4.129:38239)
I20260923 14:41:35.780052 27664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:38979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:41:35.795543 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39769
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:35.902560 27860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:35.902776 27860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:35.902839 27860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:35.907094 27860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:35.907145 27860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:35.907200 27860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:41:35.912189 27860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:35.913060 27860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:35.914125 27860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:35.923317 27868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:35.923308 27865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:35.923308 27866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:35.923341 27860 server_base.cc:1034] running on GCE node
I20260923 14:41:35.923938 27860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:35.924479 27860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:35.925630 27860 hybrid_clock.cc:648] HybridClock initialized: now 1790174495925602 us; error 39 us; skew 500 ppm
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:35.928247 27860 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:41:35.929087 27860 webserver.cc:460] Webserver started at http://127.17.4.130:44439/ using document root <none> and password file <none>
I20260923 14:41:35.929620 27860 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:35.929705 27860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:35.929931 27860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:35.931885 27860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "70956d080140490a9d53c9a174eaa72e"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "3ab9f4f1c47880de140c468ce30a3f1a"
server_key_iv: "352247a435f8015d6dc5c2705d33fdf9"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.932415 27860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "70956d080140490a9d53c9a174eaa72e"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "3ab9f4f1c47880de140c468ce30a3f1a"
server_key_iv: "352247a435f8015d6dc5c2705d33fdf9"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.936010 27860 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:41:35.938305 27875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.939489 27860 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:35.939617 27860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "70956d080140490a9d53c9a174eaa72e"
format_stamp: "Formatted at 2026-09-23 14:41:35 on dist-test-slave-54kg"
server_key: "3ab9f4f1c47880de140c468ce30a3f1a"
server_key_iv: "352247a435f8015d6dc5c2705d33fdf9"
server_key_version: "encryptionkey@0"
I20260923 14:41:35.939720 27860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:35.953781 27860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:35.956436 27860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:35.956643 27860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:35.957185 27860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:35.958067 27860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:35.958129 27860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.958191 27860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:35.958236 27860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:35.966564 27860 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:46117
I20260923 14:41:35.966586 27988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:46117 every 8 connection(s)
I20260923 14:41:35.967374 27860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:41:35.971118 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27860
I20260923 14:41:35.971253 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:41:35.971520 17426 external_mini_cluster.cc:1428] Setting key 1093dedbee52aaf43e266ca6c9201530
Sep 23 14:41:35 dist-test-slave-54kg krb5kdc[27619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:41:35.980973 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:35.969062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:41207 (local address 127.17.4.190:39769)
0923 14:41:35.969186 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:35.969190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:35.969937 (+ 747us) server_negotiation.cc:407] Connection header received
0923 14:41:35.971198 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:35.971201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:35.971256 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:35.971338 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:35.972613 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.973357 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.974451 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.974753 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.974839 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:35.977498 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:35.977501 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:35.977503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:35.977527 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:35.978938 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:35.979419 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:35.979428 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:35.979429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:35.979498 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:35.979878 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:35.979883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:35.979885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:35.980055 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:35.980162 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:35.980695 (+ 533us) server_negotiation.cc:299] Negotiation successful
0923 14:41:35.980810 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 14:41:35.981751 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:35.969372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39769 (local address 127.17.4.130:41207)
0923 14:41:35.969797 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:35.969835 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:35.971002 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:35.971536 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:35.971543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:35.971955 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:35.972470 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:35.972489 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.973481 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.973484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:35.974321 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:35.974330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:35.974895 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:35.974901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:35.975116 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:35.975664 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:35.975689 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:35.977329 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:35.979049 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:35.979054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:35.979067 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:35.979307 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:35.979586 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:35.979591 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:35.979593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:35.979724 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:35.980159 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:35.980165 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:35.980430 (+ 265us) client_negotiation.cc:769] Sending connection context
0923 14:41:35.980638 (+ 208us) client_negotiation.cc:240] Negotiation successful
0923 14:41:35.980938 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":123,"threads_started":1}
I20260923 14:41:35.982893 27989 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39769
I20260923 14:41:35.983124 27989 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:41:35.983708 27989 heartbeater.cc:511] Master 127.17.4.190:39769 requested a full tablet report, sending...
I20260923 14:41:35.984726 27664 ts_manager.cc:194] Registered new tserver with Master: 70956d080140490a9d53c9a174eaa72e (127.17.4.130:46117)
I20260923 14:41:35.985553 27664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:41207
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:41:35.998853 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39769
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:34169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:41:36.107277 27994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:41:36.107511 27994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:41:36.107553 27994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:41:36.111326 27994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:41:36.111373 27994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:41:36.111430 27994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:41:36.116302 27994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:34169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:41:36.117321 27994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:41:36.118220 27994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:41:36.127166 27999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:36.127170 28000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:41:36.127318 28002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:41:36.127341 27994 server_base.cc:1034] running on GCE node
I20260923 14:41:36.127924 27994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:41:36.128443 27994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:41:36.129593 27994 hybrid_clock.cc:648] HybridClock initialized: now 1790174496129583 us; error 23 us; skew 500 ppm
Sep 23 14:41:36 dist-test-slave-54kg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174496, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:41:36.132212 27994 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:41:36.133061 27994 webserver.cc:460] Webserver started at http://127.17.4.131:40161/ using document root <none> and password file <none>
I20260923 14:41:36.133596 27994 fs_manager.cc:359] Metadata directory not provided
I20260923 14:41:36.133653 27994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:41:36.133870 27994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:41:36.135861 27994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "3a9d5244483541da821f11178e7b4692"
format_stamp: "Formatted at 2026-09-23 14:41:36 on dist-test-slave-54kg"
server_key: "e5111a248efb467a2b26e859f895c0c7"
server_key_iv: "dd7f9a25396583e3dfcbbac4c3cc979a"
server_key_version: "encryptionkey@0"
I20260923 14:41:36.136396 27994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "3a9d5244483541da821f11178e7b4692"
format_stamp: "Formatted at 2026-09-23 14:41:36 on dist-test-slave-54kg"
server_key: "e5111a248efb467a2b26e859f895c0c7"
server_key_iv: "dd7f9a25396583e3dfcbbac4c3cc979a"
server_key_version: "encryptionkey@0"
I20260923 14:41:36.140059 27994 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260923 14:41:36.142239 28009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:36.143334 27994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:41:36.143486 27994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "3a9d5244483541da821f11178e7b4692"
format_stamp: "Formatted at 2026-09-23 14:41:36 on dist-test-slave-54kg"
server_key: "e5111a248efb467a2b26e859f895c0c7"
server_key_iv: "dd7f9a25396583e3dfcbbac4c3cc979a"
server_key_version: "encryptionkey@0"
I20260923 14:41:36.143592 27994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:41:36.160156 27994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:41:36.163105 27994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:41:36.163335 27994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:41:36.164129 27994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:41:36.165148 27994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:41:36.165231 27994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:36.165282 27994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:41:36.165310 27994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:41:36.177356 27994 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:36119
I20260923 14:41:36.177495 28122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:36119 every 8 connection(s)
I20260923 14:41:36.178238 27994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:41:36.184806 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 27994
I20260923 14:41:36.184922 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:41:36.185220 17426 external_mini_cluster.cc:1428] Setting key cf3b300ea4d16c50010cc273d2bfeaed
Sep 23 14:41:36 dist-test-slave-54kg krb5kdc[27619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174496, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:41:36.195443 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.180301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:39769 (local address 127.17.4.190:39769)
0923 14:41:36.180480 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.180485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.181571 (+ 1086us) server_negotiation.cc:407] Connection header received
0923 14:41:36.183227 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.183230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.183282 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.183397 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:36.185020 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.185760 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.187272 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.187618 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.187797 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.191069 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:36.191074 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:36.191077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:36.191113 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:36.192820 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:36.193557 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:36.193563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:36.193566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:36.193654 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:36.194138 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:36.194143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:36.194147 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:36.194402 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:36.194498 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.195183 (+ 685us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.195309 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 14:41:36.197041 28125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.180817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39769 (local address 127.17.4.131:39769)
0923 14:41:36.181388 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.181457 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:36.183015 (+ 1558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:36.183582 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:36.183589 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:36.184150 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:41:36.184823 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.184845 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.185932 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.185935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.187136 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.187146 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.187844 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.187849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.188027 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.188785 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:41:36.188813 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:41:36.190880 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:41:36.192974 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:36.192982 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:36.193029 (+ 47us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:36.193404 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:36.193768 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:41:36.193773 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:41:36.193777 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:41:36.193993 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:41:36.194535 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:41:36.194545 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:41:36.194888 (+ 343us) client_negotiation.cc:769] Sending connection context
0923 14:41:36.195610 (+ 722us) client_negotiation.cc:240] Negotiation successful
0923 14:41:36.195964 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":143,"threads_started":1}
I20260923 14:41:36.198321 28123 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39769
I20260923 14:41:36.198554 28123 heartbeater.cc:464] Registering TS with master...
I20260923 14:41:36.199126 28123 heartbeater.cc:511] Master 127.17.4.190:39769 requested a full tablet report, sending...
I20260923 14:41:36.200204 27664 ts_manager.cc:194] Registered new tserver with Master: 3a9d5244483541da821f11178e7b4692 (127.17.4.131:36119)
I20260923 14:41:36.200989 27664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:39769
I20260923 14:41:36.210554 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:41:36.219643 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.212546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57822 (local address 127.17.4.190:39769)
0923 14:41:36.212657 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.212662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.212810 (+ 148us) server_negotiation.cc:407] Connection header received
0923 14:41:36.212912 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.212915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.212950 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.213012 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:41:36.213661 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.214137 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.215381 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.215589 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.215664 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.216921 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:41:36.216924 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:41:36.216926 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:41:36.216946 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:41:36.218345 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:36.218687 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:36.218690 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:36.218691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:36.218759 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:41:36.218975 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:41:36.218977 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:41:36.218978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:41:36.219160 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:41:36.219258 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.219446 (+ 188us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.219541 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:41:36.222090 27664 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:41:36.225051 27664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:41:36.239117 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.233139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:38239 (local address 127.0.0.1:41470)
0923 14:41:36.234138 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.234151 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:36.234235 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:36.234812 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:36.234815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:36.234828 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:36.234921 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.234925 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.236382 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.236385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.237651 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.237661 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.238569 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.238572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.238691 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.238726 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 14:41:36.238855 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 14:41:36.238971 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":940,"mutex_wait_us":54,"thread_start_us":78,"threads_started":1}
I20260923 14:41:36.239122 28138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.233554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41470 (local address 127.17.4.129:38239)
0923 14:41:36.233994 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.234007 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.234332 (+ 325us) server_negotiation.cc:407] Connection header received
0923 14:41:36.234404 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.234408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.234568 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.234697 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:36.235082 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.236208 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.237769 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.238451 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.238567 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.238718 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.238892 (+ 174us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.238980 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":94,"threads_started":1}
I20260923 14:41:36.239506 28134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.232797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:46117 (local address 127.0.0.1:56754)
0923 14:41:36.233346 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.233402 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:36.233528 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:36.234548 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:36.234554 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:36.234588 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:36.234874 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.234883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.236356 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.236359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.237692 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.237699 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.238966 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.238970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.239210 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.239242 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 14:41:36.239317 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 14:41:36.239384 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":193,"spinlock_wait_cycles":7168,"thread_start_us":93,"threads_started":1}
I20260923 14:41:36.239595 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.232915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56754 (local address 127.17.4.130:46117)
0923 14:41:36.233834 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.233843 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.233864 (+ 21us) server_negotiation.cc:407] Connection header received
0923 14:41:36.233961 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.233967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.234177 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.234340 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:36.235003 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.236218 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.237817 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.238673 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.238774 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.238901 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.239359 (+ 458us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.239456 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"thread_start_us":88,"threads_started":1}
I20260923 14:41:36.240126 28137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.232862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:36119 (local address 127.0.0.1:59170)
0923 14:41:36.233591 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.233605 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:36.233679 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:36.234548 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:36.234554 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:36.234589 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:36.234895 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.234900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.235978 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.235983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.237668 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.237679 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.238966 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.238970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.239834 (+ 864us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.239859 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:41:36.239934 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 14:41:36.239998 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":861,"spinlock_wait_cycles":6912,"thread_start_us":91,"threads_started":1}
I20260923 14:41:36.240552 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.233554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.17.4.131:36119)
0923 14:41:36.234069 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.234081 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.234104 (+ 23us) server_negotiation.cc:407] Connection header received
0923 14:41:36.234184 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.234192 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.234384 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.234525 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:36.235039 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.235862 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.237817 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.238673 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.238774 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.238907 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.240299 (+ 1392us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.240411 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":97,"threads_started":1}
I20260923 14:41:36.242182 27789 tablet_service.cc:1467] Processing CreateTablet for tablet c8eb364d926a4ead8645ac9b700a1609 (DEFAULT_TABLE table=test-table [id=1b116280a8254e1c8cbf0830b3440147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:36.242662 28043 tablet_service.cc:1467] Processing CreateTablet for tablet c8eb364d926a4ead8645ac9b700a1609 (DEFAULT_TABLE table=test-table [id=1b116280a8254e1c8cbf0830b3440147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:36.243144 27789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8eb364d926a4ead8645ac9b700a1609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:36.243414 28043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8eb364d926a4ead8645ac9b700a1609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:36.249842 28140 tablet_bootstrap.cc:492] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Bootstrap starting.
I20260923 14:41:36.249642 27923 tablet_service.cc:1467] Processing CreateTablet for tablet c8eb364d926a4ead8645ac9b700a1609 (DEFAULT_TABLE table=test-table [id=1b116280a8254e1c8cbf0830b3440147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:41:36.250614 27923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8eb364d926a4ead8645ac9b700a1609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:41:36.250865 28141 tablet_bootstrap.cc:492] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: Bootstrap starting.
I20260923 14:41:36.251859 28140 tablet_bootstrap.cc:654] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:36.252822 28141 tablet_bootstrap.cc:654] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:36.252848 28140 log.cc:824] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:36.254042 28141 log.cc:824] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:36.254633 28140 tablet_bootstrap.cc:492] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: No bootstrap required, opened a new log
I20260923 14:41:36.254810 28140 ts_tablet_manager.cc:1397] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260923 14:41:36.255903 28141 tablet_bootstrap.cc:492] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: No bootstrap required, opened a new log
I20260923 14:41:36.256083 28141 ts_tablet_manager.cc:1397] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:41:36.257454 28144 tablet_bootstrap.cc:492] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Bootstrap starting.
I20260923 14:41:36.258495 28140 raft_consensus.cc:348] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.258750 28140 raft_consensus.cc:374] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:36.258805 28140 raft_consensus.cc:729] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9d5244483541da821f11178e7b4692, State: Initialized, Role: FOLLOWER
I20260923 14:41:36.259274 28140 consensus_queue.cc:260] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.259409 28141 raft_consensus.cc:348] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.259703 28141 raft_consensus.cc:374] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:36.259789 28141 raft_consensus.cc:729] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34cfacde69964cc6a3c80cd1ce72ef90, State: Initialized, Role: FOLLOWER
I20260923 14:41:36.260133 28123 heartbeater.cc:503] Master 127.17.4.190:39769 was elected leader, sending a full tablet report...
I20260923 14:41:36.260192 28144 tablet_bootstrap.cc:654] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Neither blocks nor log segments found. Creating new log.
I20260923 14:41:36.260257 28141 consensus_queue.cc:260] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.260403 28140 ts_tablet_manager.cc:1428] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260923 14:41:36.260913 28144 log.cc:824] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:41:36.261113 28141 ts_tablet_manager.cc:1428] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:41:36.261431 27855 heartbeater.cc:503] Master 127.17.4.190:39769 was elected leader, sending a full tablet report...
W20260923 14:41:36.262485 27856 tablet.cc:2369] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:36.264182 28144 tablet_bootstrap.cc:492] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: No bootstrap required, opened a new log
I20260923 14:41:36.264390 28144 ts_tablet_manager.cc:1397] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260923 14:41:36.267360 28144 raft_consensus.cc:348] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.267567 28144 raft_consensus.cc:374] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:41:36.267620 28144 raft_consensus.cc:729] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70956d080140490a9d53c9a174eaa72e, State: Initialized, Role: FOLLOWER
I20260923 14:41:36.268011 28144 consensus_queue.cc:260] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.268579 27989 heartbeater.cc:503] Master 127.17.4.190:39769 was elected leader, sending a full tablet report...
I20260923 14:41:36.268781 28144 ts_tablet_manager.cc:1428] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260923 14:41:36.429312 28124 tablet.cc:2369] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:41:36.468588 27990 tablet.cc:2369] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:41:36.572185 28148 raft_consensus.cc:482] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:41:36.572432 28148 raft_consensus.cc:504] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.573683 28148 leader_election.cc:288] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9d5244483541da821f11178e7b4692 (127.17.4.131:36119), 34cfacde69964cc6a3c80cd1ce72ef90 (127.17.4.129:38239)
I20260923 14:41:36.577672 28138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.574041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:50659 (local address 127.17.4.129:38239)
0923 14:41:36.574167 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.574174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.574372 (+ 198us) server_negotiation.cc:407] Connection header received
0923 14:41:36.574556 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.574559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.574600 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.574685 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:36.575016 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.575516 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.576716 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.577101 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.577228 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.577298 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.577473 (+ 175us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.577537 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:41:36.577690 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.574026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:38907 (local address 127.17.4.131:36119)
0923 14:41:36.574164 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.574169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.574361 (+ 192us) server_negotiation.cc:407] Connection header received
0923 14:41:36.574552 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.574555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.574600 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.574684 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:41:36.575026 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.575510 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.576724 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.577126 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.577250 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.577315 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.577500 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.577565 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:41:36.577713 28150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.573883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:36119 (local address 127.17.4.130:38907)
0923 14:41:36.574254 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.574266 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:36.574432 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:36.574697 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:36.574699 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:36.574724 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:36.574913 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.574918 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.575618 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.575623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.576601 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.576610 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.577244 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.577248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.577371 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.577396 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:41:36.577483 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 14:41:36.577551 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":133,"spinlock_wait_cycles":34176,"thread_start_us":108,"threads_started":1}
I20260923 14:41:36.577725 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.573969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:38239 (local address 127.17.4.130:50659)
0923 14:41:36.574273 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.574285 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:41:36.574437 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:41:36.574697 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:41:36.574699 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:41:36.574727 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:41:36.574898 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.574904 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.575629 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.575633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.576591 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:41:36.576600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.577219 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.577223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:41:36.577335 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.577363 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 14:41:36.577457 (+ 94us) client_negotiation.cc:240] Negotiation successful
0923 14:41:36.577527 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":92,"spinlock_wait_cycles":7808,"thread_start_us":78,"threads_started":1}
I20260923 14:41:36.578361 28077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8eb364d926a4ead8645ac9b700a1609" candidate_uuid: "70956d080140490a9d53c9a174eaa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9d5244483541da821f11178e7b4692" is_pre_election: true
I20260923 14:41:36.578490 27809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8eb364d926a4ead8645ac9b700a1609" candidate_uuid: "70956d080140490a9d53c9a174eaa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" is_pre_election: true
I20260923 14:41:36.578713 28077 raft_consensus.cc:2454] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70956d080140490a9d53c9a174eaa72e in term 0.
I20260923 14:41:36.578802 27809 raft_consensus.cc:2454] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70956d080140490a9d53c9a174eaa72e in term 0.
I20260923 14:41:36.579217 27877 leader_election.cc:302] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 34cfacde69964cc6a3c80cd1ce72ef90, 3a9d5244483541da821f11178e7b4692, 70956d080140490a9d53c9a174eaa72e; no voters:
I20260923 14:41:36.579474 28148 raft_consensus.cc:2781] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:41:36.579564 28148 raft_consensus.cc:482] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:41:36.579643 28148 raft_consensus.cc:3037] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:36.580698 28148 raft_consensus.cc:504] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.581040 28148 leader_election.cc:288] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [CANDIDATE]: Term 1 election: Requested vote from peers 3a9d5244483541da821f11178e7b4692 (127.17.4.131:36119), 34cfacde69964cc6a3c80cd1ce72ef90 (127.17.4.129:38239)
I20260923 14:41:36.581477 27809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8eb364d926a4ead8645ac9b700a1609" candidate_uuid: "70956d080140490a9d53c9a174eaa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34cfacde69964cc6a3c80cd1ce72ef90"
I20260923 14:41:36.581465 28077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8eb364d926a4ead8645ac9b700a1609" candidate_uuid: "70956d080140490a9d53c9a174eaa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9d5244483541da821f11178e7b4692"
I20260923 14:41:36.581604 28077 raft_consensus.cc:3037] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:36.581599 27809 raft_consensus.cc:3037] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:41:36.582844 27809 raft_consensus.cc:2454] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70956d080140490a9d53c9a174eaa72e in term 1.
I20260923 14:41:36.582851 28077 raft_consensus.cc:2454] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70956d080140490a9d53c9a174eaa72e in term 1.
I20260923 14:41:36.583120 27878 leader_election.cc:302] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34cfacde69964cc6a3c80cd1ce72ef90, 70956d080140490a9d53c9a174eaa72e; no voters:
I20260923 14:41:36.583341 28148 raft_consensus.cc:2781] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:41:36.583557 28148 raft_consensus.cc:686] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 1 LEADER]: Becoming Leader. State: Replica: 70956d080140490a9d53c9a174eaa72e, State: Running, Role: LEADER
I20260923 14:41:36.584095 28148 consensus_queue.cc:237] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } }
I20260923 14:41:36.587056 27664 catalog_manager.cc:5495] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e reported cstate change: term changed from 0 to 1, leader changed from <none> to 70956d080140490a9d53c9a174eaa72e (127.17.4.130). New cstate: current_term: 1 leader_uuid: "70956d080140490a9d53c9a174eaa72e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70956d080140490a9d53c9a174eaa72e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 } health_report { overall_health: UNKNOWN } } }
I20260923 14:41:36.597632 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.594028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.17.4.130:46117)
0923 14:41:36.594152 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:41:36.594157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:41:36.594224 (+ 67us) server_negotiation.cc:407] Connection header received
0923 14:41:36.594410 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:41:36.594413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:41:36.594456 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:41:36.594557 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:41:36.594794 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.595268 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.596238 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:41:36.596461 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:41:36.596568 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:41:36.596877 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:41:36.597243 (+ 366us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:41:36.597387 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 14:41:36.597449 (+ 62us) server_negotiation.cc:299] Negotiation successful
0923 14:41:36.597500 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:41:36.603075 28077 raft_consensus.cc:1261] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 1 FOLLOWER]: Refusing update from remote peer 70956d080140490a9d53c9a174eaa72e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:36.603076 27809 raft_consensus.cc:1261] T c8eb364d926a4ead8645ac9b700a1609 P 34cfacde69964cc6a3c80cd1ce72ef90 [term 1 FOLLOWER]: Refusing update from remote peer 70956d080140490a9d53c9a174eaa72e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:41:36.603886 28151 consensus_queue.cc:1035] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "34cfacde69964cc6a3c80cd1ce72ef90" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:36.604074 28148 consensus_queue.cc:1035] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9d5244483541da821f11178e7b4692" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:41:36.610354 28154 mvcc.cc:205] Tried to move back new op lower bound from 7332554738078920704 to 7332554738010882048. Current Snapshot: MvccSnapshot[applied={T|T < 7332554738078920704}]
I20260923 14:41:36.613251 28156 mvcc.cc:205] Tried to move back new op lower bound from 7332554738078920704 to 7332554738010882048. Current Snapshot: MvccSnapshot[applied={T|T < 7332554738078920704}]
I20260923 14:41:36.620524 27664 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:36.620692 27664 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:41:36.622963 27664 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ba8f227325f4a8d926e935ebe9a0a6f: Sending DeleteTablet for 3 replicas of tablet c8eb364d926a4ead8645ac9b700a1609
I20260923 14:41:36.623713 27923 tablet_service.cc:1514] Processing DeleteTablet for tablet c8eb364d926a4ead8645ac9b700a1609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:36 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:56754
I20260923 14:41:36.623709 28043 tablet_service.cc:1514] Processing DeleteTablet for tablet c8eb364d926a4ead8645ac9b700a1609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:36 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:59170
I20260923 14:41:36.623809 27789 tablet_service.cc:1514] Processing DeleteTablet for tablet c8eb364d926a4ead8645ac9b700a1609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:41:36 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:41470
I20260923 14:41:36.624208 28164 tablet_replica.cc:330] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: stopping tablet replica
I20260923 14:41:36.624421 28165 tablet_replica.cc:330] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: stopping tablet replica
I20260923 14:41:36.624522 28164 raft_consensus.cc:2229] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:41:36.624708 28165 raft_consensus.cc:2229] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:41:36.624892 28164 raft_consensus.cc:2258] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:36.624985 28165 raft_consensus.cc:2258] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:41:36.625125 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27726
I20260923 14:41:36.627103 28164 ts_tablet_manager.cc:1905] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:41:36.629860 28164 ts_tablet_manager.cc:1918] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:36.629952 28164 log.cc:1196] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/c8eb364d926a4ead8645ac9b700a1609
I20260923 14:41:36.630257 28164 ts_tablet_manager.cc:1939] T c8eb364d926a4ead8645ac9b700a1609 P 70956d080140490a9d53c9a174eaa72e: Deleting consensus metadata
I20260923 14:41:36.631295 27651 catalog_manager.cc:4841] TS 70956d080140490a9d53c9a174eaa72e (127.17.4.130:46117): tablet c8eb364d926a4ead8645ac9b700a1609 (table test-table [id=1b116280a8254e1c8cbf0830b3440147]) successfully deleted
I20260923 14:41:36.631472 28165 ts_tablet_manager.cc:1905] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 14:41:36.632023 27650 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:38239 (error 108)
I20260923 14:41:36.632947 28137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:41:36.632675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:38239 (local address 127.0.0.1:41478)
0923 14:41:36.632801 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 14:41:36.632868 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:38239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260923 14:41:36.633013 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27860
W20260923 14:41:36.633194 27650 catalog_manager.cc:4584] TS 34cfacde69964cc6a3c80cd1ce72ef90 (127.17.4.129:38239): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c8eb364d926a4ead8645ac9b700a1609: Network error: Client connection negotiation failed: client connection to 127.17.4.129:38239: connect: Connection refused (error 111)
I20260923 14:41:36.634586 28165 ts_tablet_manager.cc:1918] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:41:36.634686 28165 log.cc:1196] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/c8eb364d926a4ead8645ac9b700a1609
I20260923 14:41:36.635051 28165 ts_tablet_manager.cc:1939] T c8eb364d926a4ead8645ac9b700a1609 P 3a9d5244483541da821f11178e7b4692: Deleting consensus metadata
I20260923 14:41:36.636194 27649 catalog_manager.cc:4841] TS 3a9d5244483541da821f11178e7b4692 (127.17.4.131:36119): tablet c8eb364d926a4ead8645ac9b700a1609 (table test-table [id=1b116280a8254e1c8cbf0830b3440147]) successfully deleted
I20260923 14:41:36.638171 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27994
I20260923 14:41:36.643200 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 27632
2026-09-23T14:41:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2466 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:41:36 dist-test-slave-54kg krb5kdc[28170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:41:36 dist-test-slave-54kg krb5kdc[28170](info): set up 2 sockets
Sep 23 14:41:36 dist-test-slave-54kg krb5kdc[28170](info): commencing operation
krb5kdc: starting...
W20260923 14:41:37.683025 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:41:37 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:41:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:41:37Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/rangeradmin_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/rangeradmin_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/rangerlookup_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/rangerlookup_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
I20260923 14:41:37.842031 17426 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskUR6fzw/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/postgres -l logfile start
2026-09-23 14:41:40.216 UTC [28200] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 14:41:40.216 UTC [28200] LOG: listening on IPv4 address "127.17.4.148", port 43289
2026-09-23 14:41:40.219 UTC [28200] LOG: listening on Unix socket "/tmp/.s.PGSQL.43289"
2026-09-23 14:41:40.238 UTC [28203] LOG: database system was shut down at 2026-09-23 14:41:38 UTC
2026-09-23 14:41:40.242 UTC [28200] LOG: database system is ready to accept connections
I20260923 14:41:41.181612 17426 mini_postgres.cc:96] Postgres bound to 43289
2026-09-23 14:41:41.187 UTC [28211] FATAL: database "slave" does not exist
127.17.4.148:43289 - accepting connections
I20260923 14:41:41.188494 17426 mini_ranger.cc:161] Starting Ranger...
I20260923 14:41:41.202746 17426 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 14:41:41.661820 17426 mini_ranger.cc:87] Created ranger Postgres database
I20260923 14:41:41.661914 17426 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-admin
2026-09-23 14:41:42,037 [I] DB FLAVOR :POSTGRES
2026-09-23 14:41:42,038 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 14:41:42,038 [I] Checking connection..
2026-09-23 14:41:42,038 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 14:41:42,302 [I] Checking connection passed.
2026-09-23 14:41:42,302 [I] --------- Verifying version history table ---------
2026-09-23 14:41:42,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 14:41:42,549 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 14:41:42,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 14:41:42,802 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 14:41:42,803 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 14:41:42,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 14:41:43.048 UTC [28275] WARNING: there is no transaction in progress
2026-09-23 14:41:43,054 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 14:41:43,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 14:41:43,287 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 14:41:43,287 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 14:41:43,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 14:41:43,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 14:41:43,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-54kg.c.gcp-upstream.internal','N') ;"
2026-09-23 14:41:43,970 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 14:41:44,207 [I] Table x_portal_user does not exist in database ranger
2026-09-23 14:41:44,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 14:41:44,462 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 14:41:44,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 14:41:44,709 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 14:41:44,928 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 14:41:44,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 14:41:45.896 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:45.912 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:45.927 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:45.942 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:45.957 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:45.973 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.024 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.031 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.045 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.055 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.064 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.078 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.088 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.095 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.102 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46.108 UTC [28383] WARNING: there is no transaction in progress
2026-09-23 14:41:46,715 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 14:41:46,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 14:41:46,943 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 14:41:46,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 14:41:47,202 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 14:41:47,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 14:41:47,456 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 14:41:47,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 14:41:47,706 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 14:41:47,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-54kg.c.gcp-upstream.internal';"
2026-09-23 14:41:48,203 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 14:41:48,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 14:41:48,441 [I] DB_PATCHES have already been applied
I20260923 14:41:48.446882 17426 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-admin:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskUR6fzw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 14:41:48.446957 17426 mini_ranger.cc:193] Using host: 127.17.4.148
I20260923 14:41:48.450340 17426 mini_ranger.cc:227] Ranger admin URL: http://127.17.4.148:36833
Sep 23, 2026 2:41:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 2:41:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 2:41:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 2:41:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 2:41:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 2:41:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 2:41:49 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 14:41:50.665989 17426 mini_ranger.cc:160] Time spent starting Ranger: real 9.478s user 0.000s sys 0.011s
Sep 23, 2026 2:42:10 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 2:42:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 23, 2026 2:42:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 2:42:10 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 2:42:11 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 14:42:12.072409 17426 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/rangerkms_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/rangerkms_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.4.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.4.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 14:42:12 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174532, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 14:42:12.169521 17426 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 14:42:12.179024 17426 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 14:42:13.087062 17426 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 14:42:13.087137 17426 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms
I20260923 14:42:13.087240 17426 mini_ranger_kms.cc:227] Using postgres at 127.17.4.148:43289
2026-09-23 14:42:13,568 [I] DB FLAVOR :POSTGRES
2026-09-23 14:42:13,568 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 14:42:13,568 [I] Checking connection
2026-09-23 14:42:13,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 14:42:13,830 [I] connection success
2026-09-23 14:42:13,830 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 14:42:13,830 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 14:42:13,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 14:42:14,066 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 14:42:14,066 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 14:42:14,067 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 14:42:14,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:43289/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 14:42:14,310 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 14:42:14.768452 17426 mini_ranger_kms.cc:310] Created kms service
I20260923 14:42:14.989100 17426 mini_ranger_kms.cc:326] Created kudu user
I20260923 14:42:15.032919 17426 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 14:42:15 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174532, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:42:15.426987 17426 mini_ranger_kms.cc:384] Added ranger policy
I20260923 14:42:15.427134 17426 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms:/tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 14:42:15.427167 17426 mini_ranger_kms.cc:240] Using host: 127.17.4.148
I20260923 14:42:15.431354 17426 mini_ranger_kms.cc:276] Ranger KMS PID: 28565
I20260923 14:42:15.431475 17426 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.4.148:50797
Sep 23, 2026 2:42:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 2:42:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 2:42:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 2:42:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 2:42:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 2:42:17 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260923 14:42:17.682137 17426 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.513s user 0.028s sys 0.245s
I20260923 14:42:17.682273 17426 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 14:42:17.682387 17426 mini_ranger_kms.cc:401] 127.17.4.148:50797/kms/v1/keys
Sep 23 14:42:17 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790174537, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.4.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 23 14:42:18 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174537, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.4.148@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
Sep 23 14:42:18 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174537, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.4.148@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
Sep 23 14:42:20 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:42:20.907188 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:37491
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:37491
--ranger_config_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:50797/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:42:21.049949 28615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:42:21.050252 28615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:42:21.050331 28615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:42:21.054565 28615 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:42:21.054647 28615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:42:21.054683 28615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:42:21.054739 28615 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:42:21.054787 28615 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:42:21.060510 28615 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.4.148:50797/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:37491
--ranger_config_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:37491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:42:21.061628 28615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:42:21.062690 28615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:42:21.072579 28620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:42:21.072845 28615 server_base.cc:1034] running on GCE node
W20260923 14:42:21.072626 28623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:42:21.072623 28621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:42:21.073531 28615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:42:21.074582 28615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:42:21.075802 28615 hybrid_clock.cc:648] HybridClock initialized: now 1790174541075746 us; error 37 us; skew 500 ppm
Sep 23 14:42:21 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174541, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:42:21.078770 28615 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:42:21.079731 28615 webserver.cc:460] Webserver started at http://127.17.4.190:45973/ using document root <none> and password file <none>
I20260923 14:42:21.080281 28615 fs_manager.cc:359] Metadata directory not provided
I20260923 14:42:21.080356 28615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:42:21.080554 28615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:42:21 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174541, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:42:21.139029 28615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "576a154bfd08482c87e2d142e8ab2504"
format_stamp: "Formatted at 2026-09-23 14:42:21 on dist-test-slave-54kg"
server_key: "4a833c2fd2383dba92dcd30cdf89d97c"
server_key_iv: "19eef0d93a428e1f01ab44f1fcca3f98"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:21.139995 28615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "576a154bfd08482c87e2d142e8ab2504"
format_stamp: "Formatted at 2026-09-23 14:42:21 on dist-test-slave-54kg"
server_key: "4a833c2fd2383dba92dcd30cdf89d97c"
server_key_iv: "19eef0d93a428e1f01ab44f1fcca3f98"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:21.144999 28615 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 14:42:21.161335 28630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:21.162904 28615 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 14:42:21.163043 28615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "576a154bfd08482c87e2d142e8ab2504"
format_stamp: "Formatted at 2026-09-23 14:42:21 on dist-test-slave-54kg"
server_key: "4a833c2fd2383dba92dcd30cdf89d97c"
server_key_iv: "19eef0d93a428e1f01ab44f1fcca3f98"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:21.163165 28615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:42:21.192512 28615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:42:21.195885 28615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:42:21.196091 28615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:42:21.205502 28615 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:37491
I20260923 14:42:21.205521 28682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:37491 every 8 connection(s)
I20260923 14:42:21.206691 28615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:42:21.209604 28683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:42:21.215161 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 28615
I20260923 14:42:21.215247 28683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504: Bootstrap starting.
I20260923 14:42:21.215282 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:42:21.215581 17426 external_mini_cluster.cc:1428] Setting key 60a91605f8121790b8f6f926f5a3f356
I20260923 14:42:21.218706 28683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504: Neither blocks nor log segments found. Creating new log.
I20260923 14:42:21.219569 28683 log.cc:824] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504: Log is configured to *not* fsync() on all Append() calls
I20260923 14:42:21.221710 28683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504: No bootstrap required, opened a new log
I20260923 14:42:21.225572 28683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "576a154bfd08482c87e2d142e8ab2504" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37491 } }
I20260923 14:42:21.225858 28683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:42:21.225941 28683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576a154bfd08482c87e2d142e8ab2504, State: Initialized, Role: FOLLOWER
Sep 23 14:42:21 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:42:21.226446 28683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "576a154bfd08482c87e2d142e8ab2504" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37491 } }
I20260923 14:42:21.226639 28683 raft_consensus.cc:388] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:42:21.226770 28683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:42:21.226887 28683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:42:21.228076 28683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "576a154bfd08482c87e2d142e8ab2504" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37491 } }
I20260923 14:42:21.228467 28683 leader_election.cc:302] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 576a154bfd08482c87e2d142e8ab2504; no voters:
I20260923 14:42:21.228802 28683 leader_election.cc:288] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:42:21.228967 28688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:42:21.229210 28688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [term 1 LEADER]: Becoming Leader. State: Replica: 576a154bfd08482c87e2d142e8ab2504, State: Running, Role: LEADER
I20260923 14:42:21.229554 28688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "576a154bfd08482c87e2d142e8ab2504" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37491 } }
I20260923 14:42:21.230186 28683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:42:21.230829 28688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "576a154bfd08482c87e2d142e8ab2504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "576a154bfd08482c87e2d142e8ab2504" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37491 } } }
I20260923 14:42:21.231007 28688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [sys.catalog]: This master's current role is: LEADER
I20260923 14:42:21.231251 28688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 576a154bfd08482c87e2d142e8ab2504. Latest consensus state: current_term: 1 leader_uuid: "576a154bfd08482c87e2d142e8ab2504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "576a154bfd08482c87e2d142e8ab2504" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37491 } } }
I20260923 14:42:21.231375 28688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504 [sys.catalog]: This master's current role is: LEADER
I20260923 14:42:21.231665 28696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:42:21.232610 28686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:21.216996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45100 (local address 127.17.4.190:37491)
0923 14:42:21.217403 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:21.217421 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:21.217471 (+ 50us) server_negotiation.cc:407] Connection header received
0923 14:42:21.218492 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:21.218516 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:21.218916 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:21.219259 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:42:21.220190 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:21.221593 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:21.222780 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:21.223557 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:21.223714 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:21.226959 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:42:21.226967 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:42:21.226996 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:42:21.227027 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:42:21.229123 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:21.229612 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:21.229618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:21.229623 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:21.229747 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:21.230093 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:21.230096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:21.230097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:21.230607 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:42:21.230763 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:21.231291 (+ 528us) server_negotiation.cc:299] Negotiation successful
0923 14:42:21.231572 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":115,"threads_started":1}
I20260923 14:42:21.235852 28696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:42:21.236227 28683 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 14:42:21.244827 28696 catalog_manager.cc:1347] Generated new cluster ID: 4d8304262a0643189a556313efe3280d
I20260923 14:42:21.244900 28696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:42:21.275642 28696 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:42:21.278128 28696 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:42:21.288264 28696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504: Generated new TSK 0
I20260923 14:42:21.289088 28696 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:42:22.019527 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:50797/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37491
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:42:22.140950 28728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:42:22.141211 28728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:42:22.141281 28728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:42:22.145563 28728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:42:22.145642 28728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:42:22.145728 28728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:42:22.152884 28728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.4.148:50797/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:42:22.154124 28728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:42:22.155459 28728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:42:22.166595 28736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:42:22.166836 28738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:42:22.166589 28735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:42:22.167846 28728 server_base.cc:1034] running on GCE node
I20260923 14:42:22.168413 28728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:42:22.169186 28728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:42:22.172534 28728 hybrid_clock.cc:648] HybridClock initialized: now 1790174542172509 us; error 32 us; skew 500 ppm
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:42:22.176026 28728 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:42:22.176841 28728 webserver.cc:460] Webserver started at http://127.17.4.129:45241/ using document root <none> and password file <none>
I20260923 14:42:22.177392 28728 fs_manager.cc:359] Metadata directory not provided
I20260923 14:42:22.177450 28728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:42:22.177659 28728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:42:22.199122 28728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "4d161603583e47e8a7b37a3e0d27fa98"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "66ac2232b03a59f4705c789f2d7aa2e7"
server_key_iv: "f1bd6de1053b10572170d30a2f78d5ec"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.200209 28728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "4d161603583e47e8a7b37a3e0d27fa98"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "66ac2232b03a59f4705c789f2d7aa2e7"
server_key_iv: "f1bd6de1053b10572170d30a2f78d5ec"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.205963 28728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 14:42:22.222409 28745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.224164 28728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:42:22.224349 28728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "4d161603583e47e8a7b37a3e0d27fa98"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "66ac2232b03a59f4705c789f2d7aa2e7"
server_key_iv: "f1bd6de1053b10572170d30a2f78d5ec"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.224560 28728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:42:22.245683 28728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:42:22.249435 28728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:42:22.249696 28728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:42:22.250583 28728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:42:22.251812 28728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:42:22.251924 28728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.252049 28728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:42:22.252132 28728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.264976 28728 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:40133
I20260923 14:42:22.266098 28728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:42:22.268863 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 28728
I20260923 14:42:22.268978 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:42:22.269454 17426 external_mini_cluster.cc:1428] Setting key 4c8608189a1073de5a7652b5075088cd
I20260923 14:42:22.271598 28858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:40133 every 8 connection(s)
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:42:22.286681 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.270215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37491 (local address 127.17.4.129:54549)
0923 14:42:22.271611 (+ 1396us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:22.271668 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:22.273554 (+ 1886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:22.274269 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:22.274278 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:22.274602 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:42:22.275230 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.275247 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.276383 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.276387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.277780 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.277790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.278577 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.278582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.278775 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.279467 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:42:22.279488 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:42:22.281249 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:42:22.283537 (+ 2288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:42:22.283542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:42:22.283556 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:42:22.283903 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:42:22.284220 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:42:22.284223 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:42:22.284225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:42:22.284385 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:42:22.284840 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:42:22.284846 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:42:22.285137 (+ 291us) client_negotiation.cc:769] Sending connection context
0923 14:42:22.285313 (+ 176us) client_negotiation.cc:240] Negotiation successful
0923 14:42:22.285625 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"thread_start_us":152,"threads_started":1}
I20260923 14:42:22.287513 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.271347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:54549 (local address 127.17.4.190:37491)
0923 14:42:22.271932 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.271941 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.271957 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:42:22.273813 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.273816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.273866 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:22.273957 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:42:22.275386 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.276240 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.277915 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.278290 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.278398 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.281434 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:42:22.281437 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:42:22.281440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:42:22.281464 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:42:22.283404 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.284027 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.284031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.284033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.284118 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.284492 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.284495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.284497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.284704 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:42:22.284790 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:22.287224 (+ 2434us) server_negotiation.cc:299] Negotiation successful
0923 14:42:22.287349 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":100,"threads_started":1}
I20260923 14:42:22.288509 28859 heartbeater.cc:347] Connected to a master server at 127.17.4.190:37491
I20260923 14:42:22.288790 28859 heartbeater.cc:464] Registering TS with master...
I20260923 14:42:22.289381 28859 heartbeater.cc:511] Master 127.17.4.190:37491 requested a full tablet report, sending...
I20260923 14:42:22.291056 28647 ts_manager.cc:194] Registered new tserver with Master: 4d161603583e47e8a7b37a3e0d27fa98 (127.17.4.129:40133)
I20260923 14:42:22.292579 28647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:54549
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:42:22.311173 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:50797/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37491
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 14:42:22.472709 28867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:42:22.473055 28867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:42:22.473119 28867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:42:22.479213 28867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:42:22.479288 28867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:42:22.479375 28867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:42:22.487092 28867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.4.148:50797/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:42:22.488552 28867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:42:22.489880 28867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:42:22.502692 28876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:42:22.503131 28874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:42:22.504444 28867 server_base.cc:1034] running on GCE node
W20260923 14:42:22.504667 28873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:42:22.505193 28867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:42:22.505898 28867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:42:22.507081 28867 hybrid_clock.cc:648] HybridClock initialized: now 1790174542507048 us; error 46 us; skew 500 ppm
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:42:22.511032 28867 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:42:22.512045 28867 webserver.cc:460] Webserver started at http://127.17.4.130:36151/ using document root <none> and password file <none>
I20260923 14:42:22.512790 28867 fs_manager.cc:359] Metadata directory not provided
I20260923 14:42:22.512931 28867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:42:22.513208 28867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:42:22.533425 28867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "9937eef263a04c10847ae19c9ceff106"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "b45fa37d984dfb125680f55b1958103b"
server_key_iv: "d451bf3367d2a130d9e5bff8b182f975"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.534320 28867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "9937eef263a04c10847ae19c9ceff106"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "b45fa37d984dfb125680f55b1958103b"
server_key_iv: "d451bf3367d2a130d9e5bff8b182f975"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.539834 28867 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260923 14:42:22.562413 28883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.564077 28867 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:42:22.564189 28867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "9937eef263a04c10847ae19c9ceff106"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "b45fa37d984dfb125680f55b1958103b"
server_key_iv: "d451bf3367d2a130d9e5bff8b182f975"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.564297 28867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:42:22.583751 28867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:42:22.587234 28867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:42:22.587426 28867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:42:22.588090 28867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:42:22.589108 28867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:42:22.589181 28867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.589279 28867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:42:22.589325 28867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.600903 28867 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:42949
I20260923 14:42:22.601783 28867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:42:22.604578 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 28867
I20260923 14:42:22.604686 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:42:22.604974 17426 external_mini_cluster.cc:1428] Setting key 9e758957b267d1387caadf7133723a11
I20260923 14:42:22.605574 28996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:42949 every 8 connection(s)
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:42:22.619256 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.603911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:40635 (local address 127.17.4.190:37491)
0923 14:42:22.605305 (+ 1394us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.605312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.606453 (+ 1141us) server_negotiation.cc:407] Connection header received
0923 14:42:22.607666 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.607672 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.607727 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:22.607842 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:42:22.609325 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.609857 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.611318 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.611735 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.611863 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.614719 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:42:22.614726 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:42:22.614731 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:42:22.614767 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:42:22.616609 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.617235 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.617243 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.617247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.617347 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.617790 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.617795 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.617796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.618074 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:42:22.618189 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:22.618807 (+ 618us) server_negotiation.cc:299] Negotiation successful
0923 14:42:22.618956 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1289}
I20260923 14:42:22.620311 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.604135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37491 (local address 127.17.4.130:40635)
0923 14:42:22.606281 (+ 2146us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:22.606330 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:22.607399 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:22.608267 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:22.608276 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:22.608613 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:42:22.609174 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.609189 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.609987 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.609990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.611183 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.611197 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.611918 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.611924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.612125 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.612766 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:42:22.612791 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:42:22.614516 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:42:22.616746 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:42:22.616753 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:42:22.616768 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:42:22.617118 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:42:22.617461 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:42:22.617464 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:42:22.617466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:42:22.617669 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:42:22.618216 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:42:22.618222 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:42:22.618510 (+ 288us) client_negotiation.cc:769] Sending connection context
0923 14:42:22.618729 (+ 219us) client_negotiation.cc:240] Negotiation successful
0923 14:42:22.619036 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1924,"thread_start_us":261,"threads_started":1}
I20260923 14:42:22.621671 28997 heartbeater.cc:347] Connected to a master server at 127.17.4.190:37491
I20260923 14:42:22.621925 28997 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:42:22.622576 28997 heartbeater.cc:511] Master 127.17.4.190:37491 requested a full tablet report, sending...
I20260923 14:42:22.623934 28647 ts_manager.cc:194] Registered new tserver with Master: 9937eef263a04c10847ae19c9ceff106 (127.17.4.130:42949)
I20260923 14:42:22.624753 28647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:40635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:42:22.639179 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:50797/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37491
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
W20260923 14:42:22.803746 29002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:42:22.804203 29002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:42:22.804312 29002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:42:22.810550 29002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:42:22.810653 29002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:42:22.810845 29002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:42:22.818624 29002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.4.148:50797/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:37491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:42:22.820168 29002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:42:22.821535 29002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:42:22.833763 29008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:42:22.834302 29010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:42:22.835291 29007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:42:22.835489 29002 server_base.cc:1034] running on GCE node
I20260923 14:42:22.835952 29002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:42:22.836675 29002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:42:22.837839 29002 hybrid_clock.cc:648] HybridClock initialized: now 1790174542837762 us; error 89 us; skew 500 ppm
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:42:22.841231 29002 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:42:22.842248 29002 webserver.cc:460] Webserver started at http://127.17.4.131:44553/ using document root <none> and password file <none>
I20260923 14:42:22.842911 29002 fs_manager.cc:359] Metadata directory not provided
I20260923 14:42:22.842981 29002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:42:22.843195 29002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:42:22.858958 29002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "b34742cd24ed45aa89fc909b0be43461"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "6e847d2a5792f9787507bfac9f365c0b"
server_key_iv: "824bed4af5c927b083e67c728eefb84a"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.859683 29002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "b34742cd24ed45aa89fc909b0be43461"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "6e847d2a5792f9787507bfac9f365c0b"
server_key_iv: "824bed4af5c927b083e67c728eefb84a"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.864517 29002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260923 14:42:22.890362 29017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.892076 29002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:42:22.892210 29002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b34742cd24ed45aa89fc909b0be43461"
format_stamp: "Formatted at 2026-09-23 14:42:22 on dist-test-slave-54kg"
server_key: "6e847d2a5792f9787507bfac9f365c0b"
server_key_iv: "824bed4af5c927b083e67c728eefb84a"
server_key_version: "kuduclusterkey@0"
I20260923 14:42:22.892356 29002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:42:22.908020 29002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:42:22.911427 29002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:42:22.911605 29002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:42:22.912281 29002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:42:22.913231 29002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:42:22.913292 29002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.913344 29002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:42:22.913419 29002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:42:22.924661 29002 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:38909
I20260923 14:42:22.924765 29130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:38909 every 8 connection(s)
I20260923 14:42:22.925597 29002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:42:22.932662 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 29002
I20260923 14:42:22.932780 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:42:22.933079 17426 external_mini_cluster.cc:1428] Setting key 44ae57007db8d3525f2d9586b51c7621
Sep 23 14:42:22 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:42:22.942384 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.929884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:34255 (local address 127.17.4.190:37491)
0923 14:42:22.930012 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.930016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.930033 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:42:22.930682 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.930686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.930755 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:22.930855 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:42:22.932274 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.933079 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.934999 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.935310 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.935377 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.938607 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:42:22.938611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:42:22.938614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:42:22.938640 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:42:22.940277 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.940826 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.940830 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.940832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.940909 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.941264 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.941267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.941269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.941453 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:42:22.941516 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:22.942127 (+ 611us) server_negotiation.cc:299] Negotiation successful
0923 14:42:22.942240 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:42:22.943837 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.928678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37491 (local address 127.17.4.131:34255)
0923 14:42:22.929241 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:22.929298 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:22.930396 (+ 1098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:22.931055 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:22.931064 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:22.931417 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:42:22.932115 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.932135 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.933221 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.933224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.934859 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.934869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.935558 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.935562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.935740 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.936398 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:42:22.936418 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:42:22.938427 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:42:22.940398 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:42:22.940403 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:42:22.940418 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:42:22.940720 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:42:22.941017 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:42:22.941020 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:42:22.941022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:42:22.941171 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:42:22.941589 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:42:22.941595 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:42:22.941868 (+ 273us) client_negotiation.cc:769] Sending connection context
0923 14:42:22.942575 (+ 707us) client_negotiation.cc:240] Negotiation successful
0923 14:42:22.942868 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":121,"threads_started":1}
I20260923 14:42:22.944916 29131 heartbeater.cc:347] Connected to a master server at 127.17.4.190:37491
I20260923 14:42:22.945169 29131 heartbeater.cc:464] Registering TS with master...
I20260923 14:42:22.945726 29131 heartbeater.cc:511] Master 127.17.4.190:37491 requested a full tablet report, sending...
I20260923 14:42:22.946789 28647 ts_manager.cc:194] Registered new tserver with Master: b34742cd24ed45aa89fc909b0be43461 (127.17.4.131:38909)
I20260923 14:42:22.947530 28647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:34255
I20260923 14:42:22.950424 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:42:22.962301 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.952814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45106 (local address 127.17.4.190:37491)
0923 14:42:22.952913 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.952917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.953221 (+ 304us) server_negotiation.cc:407] Connection header received
0923 14:42:22.953343 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.953346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.953390 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:22.953470 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:42:22.954333 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.955128 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.956412 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.956749 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.956839 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.958646 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:42:22.958650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:42:22.958652 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:42:22.958674 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:42:22.960418 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.960931 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.960935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.960937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.961035 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:42:22.961415 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:42:22.961418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:42:22.961420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:42:22.961617 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:42:22.961745 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:22.962042 (+ 297us) server_negotiation.cc:299] Negotiation successful
0923 14:42:22.962153 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:42:22.965765 28647 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:42:22.970274 28647 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:42:22.988072 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.979922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:42949 (local address 127.0.0.1:33794)
0923 14:42:22.982020 (+ 2098us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:22.982069 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:22.982194 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:22.982976 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:22.982982 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:22.983005 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:22.983138 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.983145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.984721 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.984725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.986123 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.986134 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.987519 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.987522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.987632 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.987668 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 14:42:22.987774 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 14:42:22.987913 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1906,"thread_start_us":100,"threads_started":1}
I20260923 14:42:22.988925 29145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.980753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.17.4.130:42949)
0923 14:42:22.982485 (+ 1732us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.982497 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.982522 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:42:22.982599 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.982605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.982803 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:22.982975 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:22.983284 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.984581 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.986281 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.987166 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.987317 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.987458 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:22.988671 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0923 14:42:22.988769 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1625,"thread_start_us":128,"threads_started":1}
I20260923 14:42:22.990458 29147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.979961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:40133 (local address 127.0.0.1:34398)
0923 14:42:22.983228 (+ 3267us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:22.983242 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:22.983326 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:22.985288 (+ 1962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:22.985291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:22.985309 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:22.985400 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.985407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.986801 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.986804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.988794 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:22.988805 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.990075 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.990079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:22.990165 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.990187 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:42:22.990264 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 14:42:22.990330 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3205,"thread_start_us":126,"threads_started":1}
I20260923 14:42:22.992103 28912 tablet_service.cc:1467] Processing CreateTablet for tablet 432d25a64e5e44bd82cdd051eb819937 (DEFAULT_TABLE table=test-table [id=a82d9821602041b790f8ddd938b62ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:42:22.992626 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.980801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34398 (local address 127.17.4.129:40133)
0923 14:42:22.983567 (+ 2766us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.983573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.983595 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:42:22.983668 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.983673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.984976 (+ 1303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:22.985126 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:22.985570 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.986672 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.988941 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:22.989754 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:22.989858 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:22.990007 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:22.991645 (+ 1638us) server_negotiation.cc:299] Negotiation successful
0923 14:42:22.991741 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2659,"thread_start_us":106,"threads_started":1}
I20260923 14:42:22.993239 28912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 432d25a64e5e44bd82cdd051eb819937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:42:22.995672 28785 tablet_service.cc:1467] Processing CreateTablet for tablet 432d25a64e5e44bd82cdd051eb819937 (DEFAULT_TABLE table=test-table [id=a82d9821602041b790f8ddd938b62ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:42:22.996788 28785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 432d25a64e5e44bd82cdd051eb819937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:42:23.005417 29150 tablet_bootstrap.cc:492] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98: Bootstrap starting.
I20260923 14:42:23.007735 29150 tablet_bootstrap.cc:654] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98: Neither blocks nor log segments found. Creating new log.
I20260923 14:42:23.008872 29150 log.cc:824] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98: Log is configured to *not* fsync() on all Append() calls
I20260923 14:42:23.009490 29149 tablet_bootstrap.cc:492] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Bootstrap starting.
I20260923 14:42:23.012015 29143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.981504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:38909 (local address 127.0.0.1:56194)
0923 14:42:22.984639 (+ 3135us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:22.984653 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:22.984739 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:23.006268 (+ 21529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:23.006272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:23.006293 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:23.006416 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.006422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.008301 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.008306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.009926 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.009938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.011547 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.011552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.011666 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.011697 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 14:42:23.011755 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 14:42:23.011860 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3069,"thread_start_us":90,"threads_started":1}
I20260923 14:42:23.013208 29149 tablet_bootstrap.cc:654] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Neither blocks nor log segments found. Creating new log.
I20260923 14:42:23.013734 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:22.981900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56194 (local address 127.17.4.131:38909)
0923 14:42:22.991999 (+ 10099us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:22.992012 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:22.992036 (+ 24us) server_negotiation.cc:407] Connection header received
0923 14:42:22.992116 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:22.992121 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:22.992317 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:23.006594 (+ 14277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:23.006755 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.008166 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.010106 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.011352 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.013248 (+ 1896us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.013417 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:23.013493 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 14:42:23.013597 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9975,"thread_start_us":148,"threads_started":1}
I20260923 14:42:23.014125 29149 log.cc:824] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Log is configured to *not* fsync() on all Append() calls
I20260923 14:42:23.016270 29149 tablet_bootstrap.cc:492] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: No bootstrap required, opened a new log
I20260923 14:42:23.016463 29149 ts_tablet_manager.cc:1397] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260923 14:42:23.016925 29065 tablet_service.cc:1467] Processing CreateTablet for tablet 432d25a64e5e44bd82cdd051eb819937 (DEFAULT_TABLE table=test-table [id=a82d9821602041b790f8ddd938b62ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:42:23.018009 29065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 432d25a64e5e44bd82cdd051eb819937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:42:23.020406 29149 raft_consensus.cc:348] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.020679 29149 raft_consensus.cc:374] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:42:23.020735 29149 raft_consensus.cc:729] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9937eef263a04c10847ae19c9ceff106, State: Initialized, Role: FOLLOWER
I20260923 14:42:23.021394 29149 consensus_queue.cc:260] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.022509 29149 ts_tablet_manager.cc:1428] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:42:23.022899 28997 heartbeater.cc:503] Master 127.17.4.190:37491 was elected leader, sending a full tablet report...
I20260923 14:42:23.028103 29154 tablet_bootstrap.cc:492] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Bootstrap starting.
I20260923 14:42:23.029650 29150 tablet_bootstrap.cc:492] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98: No bootstrap required, opened a new log
I20260923 14:42:23.029918 29150 ts_tablet_manager.cc:1397] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.005s
I20260923 14:42:23.030907 29154 tablet_bootstrap.cc:654] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Neither blocks nor log segments found. Creating new log.
I20260923 14:42:23.031981 29154 log.cc:824] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Log is configured to *not* fsync() on all Append() calls
I20260923 14:42:23.034581 29154 tablet_bootstrap.cc:492] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: No bootstrap required, opened a new log
I20260923 14:42:23.034518 29150 raft_consensus.cc:348] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.034773 29150 raft_consensus.cc:374] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:42:23.034775 29154 ts_tablet_manager.cc:1397] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260923 14:42:23.034818 29150 raft_consensus.cc:729] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d161603583e47e8a7b37a3e0d27fa98, State: Initialized, Role: FOLLOWER
I20260923 14:42:23.035348 29150 consensus_queue.cc:260] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.036049 29156 raft_consensus.cc:482] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:42:23.036185 29156 raft_consensus.cc:504] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.036491 29150 ts_tablet_manager.cc:1428] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260923 14:42:23.036818 28859 heartbeater.cc:503] Master 127.17.4.190:37491 was elected leader, sending a full tablet report...
I20260923 14:42:23.039176 29154 raft_consensus.cc:348] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.039574 29154 raft_consensus.cc:374] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:42:23.039677 29154 raft_consensus.cc:729] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34742cd24ed45aa89fc909b0be43461, State: Initialized, Role: FOLLOWER
I20260923 14:42:23.040228 29154 consensus_queue.cc:260] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.041289 29154 ts_tablet_manager.cc:1428] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:42:23.041664 29131 heartbeater.cc:503] Master 127.17.4.190:37491 was elected leader, sending a full tablet report...
I20260923 14:42:23.041772 29156 leader_election.cc:288] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9937eef263a04c10847ae19c9ceff106 (127.17.4.130:42949), b34742cd24ed45aa89fc909b0be43461 (127.17.4.131:38909)
I20260923 14:42:23.043612 29153 raft_consensus.cc:482] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:42:23.044131 29153 raft_consensus.cc:504] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.045176 29153 leader_election.cc:288] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d161603583e47e8a7b37a3e0d27fa98 (127.17.4.129:40133), b34742cd24ed45aa89fc909b0be43461 (127.17.4.131:38909)
I20260923 14:42:23.050268 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.045312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:40133 (local address 127.17.4.130:54521)
0923 14:42:23.045433 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:23.045449 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:23.045542 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:23.046513 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:23.046515 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:23.046544 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:23.046631 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.046637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.047560 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.047563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.048789 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.048798 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.049768 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.049772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.049941 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.049965 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 14:42:23.050042 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 14:42:23.050130 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260923 14:42:23.050931 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.046152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:54521 (local address 127.17.4.129:40133)
0923 14:42:23.046250 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:23.046254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:23.046265 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:42:23.046297 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:23.046302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:23.046341 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:23.046410 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:23.046748 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.047436 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.048910 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.049557 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.049665 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.049713 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:23.050754 (+ 1041us) server_negotiation.cc:299] Negotiation successful
0923 14:42:23.050824 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 14:42:23.051657 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "432d25a64e5e44bd82cdd051eb819937" candidate_uuid: "9937eef263a04c10847ae19c9ceff106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d161603583e47e8a7b37a3e0d27fa98" is_pre_election: true
I20260923 14:42:23.051915 28801 raft_consensus.cc:2454] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9937eef263a04c10847ae19c9ceff106 in term 0.
I20260923 14:42:23.052583 28885 leader_election.cc:302] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d161603583e47e8a7b37a3e0d27fa98, 9937eef263a04c10847ae19c9ceff106; no voters:
I20260923 14:42:23.052976 29153 raft_consensus.cc:2781] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:42:23.053073 29153 raft_consensus.cc:482] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:42:23.053115 29153 raft_consensus.cc:3037] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:42:23.054565 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.042552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:34811 (local address 127.17.4.131:38909)
0923 14:42:23.042661 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:23.042665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:23.043282 (+ 617us) server_negotiation.cc:407] Connection header received
0923 14:42:23.043824 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:23.043828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:23.043884 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:23.043938 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:23.047858 (+ 3920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.048585 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.053087 (+ 4502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.053686 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.053784 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.053830 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:23.054347 (+ 517us) server_negotiation.cc:299] Negotiation successful
0923 14:42:23.054422 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:42:23.054647 29153 raft_consensus.cc:504] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.055022 29153 leader_election.cc:288] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [CANDIDATE]: Term 1 election: Requested vote from peers 4d161603583e47e8a7b37a3e0d27fa98 (127.17.4.129:40133), b34742cd24ed45aa89fc909b0be43461 (127.17.4.131:38909)
I20260923 14:42:23.055267 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.041507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:38909 (local address 127.17.4.129:34811)
0923 14:42:23.043197 (+ 1690us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:23.043212 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:23.043349 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:23.045873 (+ 2524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:23.045879 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:23.045898 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:23.046065 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.046074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.048738 (+ 2664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.048741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.050018 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.050031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.053909 (+ 3878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.053912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.054215 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.054236 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 14:42:23.055035 (+ 799us) client_negotiation.cc:240] Negotiation successful
0923 14:42:23.055115 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1632,"mutex_wait_us":203,"thread_start_us":98,"threads_started":1}
I20260923 14:42:23.055649 29145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.041072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:49011 (local address 127.17.4.130:42949)
0923 14:42:23.041194 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:23.041198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:23.043070 (+ 1872us) server_negotiation.cc:407] Connection header received
0923 14:42:23.045620 (+ 2550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:23.045623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:23.045675 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:23.045729 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:23.046473 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.047269 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.053064 (+ 5795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.053686 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.053793 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.053834 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:23.055434 (+ 1600us) server_negotiation.cc:299] Negotiation successful
0923 14:42:23.055546 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 14:42:23.056236 29085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "432d25a64e5e44bd82cdd051eb819937" candidate_uuid: "4d161603583e47e8a7b37a3e0d27fa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34742cd24ed45aa89fc909b0be43461" is_pre_election: true
I20260923 14:42:23.056516 29085 raft_consensus.cc:2454] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d161603583e47e8a7b37a3e0d27fa98 in term 0.
I20260923 14:42:23.057108 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "432d25a64e5e44bd82cdd051eb819937" candidate_uuid: "9937eef263a04c10847ae19c9ceff106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d161603583e47e8a7b37a3e0d27fa98"
I20260923 14:42:23.057230 28801 raft_consensus.cc:3037] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:42:23.057812 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.045570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:38909 (local address 127.17.4.130:55357)
0923 14:42:23.050434 (+ 4864us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:23.050448 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:23.050529 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:23.054356 (+ 3827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:23.054359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:23.054379 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:23.054456 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.054462 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.055468 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.055472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.056561 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.056571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.057453 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.057457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.057545 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.057568 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 14:42:23.057622 (+ 54us) client_negotiation.cc:240] Negotiation successful
0923 14:42:23.057681 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4810,"thread_start_us":100,"threads_started":1}
I20260923 14:42:23.058396 29162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.045954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:55357 (local address 127.17.4.131:38909)
0923 14:42:23.054128 (+ 8174us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:23.054137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:23.054148 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:42:23.054188 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:23.054193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:23.054237 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:23.054554 (+ 317us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:42:23.054652 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.055359 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.056720 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.057312 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.058108 (+ 796us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.058154 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:23.058188 (+ 34us) server_negotiation.cc:299] Negotiation successful
0923 14:42:23.058250 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8086,"thread_start_us":83,"threads_started":1}
I20260923 14:42:23.058550 28801 raft_consensus.cc:2454] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9937eef263a04c10847ae19c9ceff106 in term 1.
I20260923 14:42:23.058842 29084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "432d25a64e5e44bd82cdd051eb819937" candidate_uuid: "9937eef263a04c10847ae19c9ceff106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34742cd24ed45aa89fc909b0be43461"
I20260923 14:42:23.058959 29084 raft_consensus.cc:3037] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:42:23.059212 28747 leader_election.cc:302] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d161603583e47e8a7b37a3e0d27fa98, b34742cd24ed45aa89fc909b0be43461; no voters:
I20260923 14:42:23.059548 29156 raft_consensus.cc:2741] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260923 14:42:23.060386 28885 leader_election.cc:302] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d161603583e47e8a7b37a3e0d27fa98, 9937eef263a04c10847ae19c9ceff106; no voters:
I20260923 14:42:23.060613 29085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "432d25a64e5e44bd82cdd051eb819937" candidate_uuid: "9937eef263a04c10847ae19c9ceff106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34742cd24ed45aa89fc909b0be43461" is_pre_election: true
I20260923 14:42:23.061591 29159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.040685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:42949 (local address 127.17.4.129:49011)
0923 14:42:23.042954 (+ 2269us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:23.042968 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:42:23.043452 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:42:23.046206 (+ 2754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:42:23.046208 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:42:23.046226 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:42:23.046341 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.046347 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.047408 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.047411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.052869 (+ 5458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:42:23.052881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.053906 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.053910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:42:23.054025 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.054049 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 14:42:23.058942 (+ 4893us) client_negotiation.cc:240] Negotiation successful
0923 14:42:23.060938 (+ 1996us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2203,"mutex_wait_us":2,"thread_start_us":110,"threads_started":1}
I20260923 14:42:23.062143 29084 raft_consensus.cc:2454] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9937eef263a04c10847ae19c9ceff106 in term 1.
I20260923 14:42:23.062240 28951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "432d25a64e5e44bd82cdd051eb819937" candidate_uuid: "4d161603583e47e8a7b37a3e0d27fa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9937eef263a04c10847ae19c9ceff106" is_pre_election: true
I20260923 14:42:23.062493 28951 raft_consensus.cc:2379] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d161603583e47e8a7b37a3e0d27fa98 in current term 1: Already voted for candidate 9937eef263a04c10847ae19c9ceff106 in this term.
I20260923 14:42:23.062628 29153 raft_consensus.cc:2781] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:42:23.062903 29153 raft_consensus.cc:686] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 1 LEADER]: Becoming Leader. State: Replica: 9937eef263a04c10847ae19c9ceff106, State: Running, Role: LEADER
I20260923 14:42:23.063254 29153 consensus_queue.cc:237] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } }
I20260923 14:42:23.066888 28647 catalog_manager.cc:5495] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9937eef263a04c10847ae19c9ceff106 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "9937eef263a04c10847ae19c9ceff106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9937eef263a04c10847ae19c9ceff106" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260923 14:42:23.091269 29145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.086506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.17.4.130:42949)
0923 14:42:23.086634 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:42:23.086638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:42:23.086652 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:42:23.086741 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:42:23.086744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:42:23.086809 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:42:23.086913 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:42:23.087282 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.088108 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.089239 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:42:23.089597 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:42:23.089699 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:42:23.090128 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:42:23.090712 (+ 584us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:42:23.090833 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 14:42:23.091026 (+ 193us) server_negotiation.cc:299] Negotiation successful
0923 14:42:23.091096 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 14:42:23.099052 28801 raft_consensus.cc:1261] T 432d25a64e5e44bd82cdd051eb819937 P 4d161603583e47e8a7b37a3e0d27fa98 [term 1 FOLLOWER]: Refusing update from remote peer 9937eef263a04c10847ae19c9ceff106: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:42:23.099694 29153 consensus_queue.cc:1035] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d161603583e47e8a7b37a3e0d27fa98" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 40133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:42:23.100274 29084 raft_consensus.cc:1261] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 1 FOLLOWER]: Refusing update from remote peer 9937eef263a04c10847ae19c9ceff106: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:42:23.101078 29153 consensus_queue.cc:1035] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b34742cd24ed45aa89fc909b0be43461" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 14:42:23.107923 28998 tablet.cc:2369] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 14:42:23 dist-test-slave-54kg krb5kdc[28170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174542, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:42:23.110939 29167 mvcc.cc:205] Tried to move back new op lower bound from 7332554928523509760 to 7332554928390393856. Current Snapshot: MvccSnapshot[applied={T|T < 7332554928523509760}]
I20260923 14:42:23.113948 29168 mvcc.cc:205] Tried to move back new op lower bound from 7332554928523509760 to 7332554928390393856. Current Snapshot: MvccSnapshot[applied={T|T < 7332554928523509760}]
I20260923 14:42:23.124063 28647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:42:23.124258 28647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:42:23.126308 29171 mvcc.cc:205] Tried to move back new op lower bound from 7332554928523509760 to 7332554928390393856. Current Snapshot: MvccSnapshot[applied={T|T < 7332554928523509760}]
I20260923 14:42:23.128222 28647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 576a154bfd08482c87e2d142e8ab2504: Sending DeleteTablet for 3 replicas of tablet 432d25a64e5e44bd82cdd051eb819937
I20260923 14:42:23.129328 28912 tablet_service.cc:1514] Processing DeleteTablet for tablet 432d25a64e5e44bd82cdd051eb819937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:42:23 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:33794
I20260923 14:42:23.130097 28785 tablet_service.cc:1514] Processing DeleteTablet for tablet 432d25a64e5e44bd82cdd051eb819937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:42:23 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:34398
I20260923 14:42:23.132057 29065 tablet_service.cc:1514] Processing DeleteTablet for tablet 432d25a64e5e44bd82cdd051eb819937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:42:23 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:56194
I20260923 14:42:23.133596 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 28728
I20260923 14:42:23.138325 29176 tablet_replica.cc:330] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: stopping tablet replica
I20260923 14:42:23.138657 29176 raft_consensus.cc:2229] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:42:23.139010 29176 raft_consensus.cc:2258] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:42:23.144577 29178 tablet_replica.cc:330] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: stopping tablet replica
I20260923 14:42:23.144881 29178 raft_consensus.cc:2229] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:42:23.145236 29178 raft_consensus.cc:2258] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:42:23.146886 29178 ts_tablet_manager.cc:1905] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:42:23.149961 29178 ts_tablet_manager.cc:1918] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:42:23.150063 29178 log.cc:1196] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/432d25a64e5e44bd82cdd051eb819937
I20260923 14:42:23.150408 29178 ts_tablet_manager.cc:1939] T 432d25a64e5e44bd82cdd051eb819937 P b34742cd24ed45aa89fc909b0be43461: Deleting consensus metadata
I20260923 14:42:23.151701 28632 catalog_manager.cc:4841] TS b34742cd24ed45aa89fc909b0be43461 (127.17.4.131:38909): tablet 432d25a64e5e44bd82cdd051eb819937 (table test-table [id=a82d9821602041b790f8ddd938b62ddb]) successfully deleted
I20260923 14:42:23.153162 29176 ts_tablet_manager.cc:1905] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:42:23.155733 29176 ts_tablet_manager.cc:1918] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:42:23.155851 29176 log.cc:1196] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/432d25a64e5e44bd82cdd051eb819937
I20260923 14:42:23.156180 29176 ts_tablet_manager.cc:1939] T 432d25a64e5e44bd82cdd051eb819937 P 9937eef263a04c10847ae19c9ceff106: Deleting consensus metadata
I20260923 14:42:23.157307 28634 catalog_manager.cc:4841] TS 9937eef263a04c10847ae19c9ceff106 (127.17.4.130:42949): tablet 432d25a64e5e44bd82cdd051eb819937 (table test-table [id=a82d9821602041b790f8ddd938b62ddb]) successfully deleted
W20260923 14:42:23.157939 28632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:40133 (error 108)
I20260923 14:42:23.158833 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 28867
I20260923 14:42:23.161339 29143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:42:23.160942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:40133 (local address 127.0.0.1:34410)
0923 14:42:23.161157 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0923 14:42:23.161235 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:40133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260923 14:42:23.161530 28632 catalog_manager.cc:4584] TS 4d161603583e47e8a7b37a3e0d27fa98 (127.17.4.129:40133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 432d25a64e5e44bd82cdd051eb819937: Network error: Client connection negotiation failed: client connection to 127.17.4.129:40133: connect: Connection refused (error 111)
I20260923 14:42:23.166371 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 29002
I20260923 14:42:23.172555 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 28615
I20260923 14:42:23.178565 17426 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 14:42:23.523015 17426 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 14:42:23.523149 17426 mini_ranger.cc:66] Stopping Ranger...
I20260923 14:42:23.867674 17426 mini_ranger.cc:68] Stopped Ranger
2026-09-23 14:42:23.867 UTC [28200] LOG: received smart shutdown request
2026-09-23 14:42:23.871 UTC [28200] LOG: background worker "logical replication launcher" (PID 28209) exited with exit code 1
2026-09-23 14:42:23.871 UTC [28204] LOG: shutting down
2026-09-23 14:42:24.040 UTC [28200] LOG: database system is shut down
2026-09-23T14:42:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47519 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:42:24 dist-test-slave-54kg krb5kdc[29189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:42:24 dist-test-slave-54kg krb5kdc[29189](info): set up 2 sockets
Sep 23 14:42:24 dist-test-slave-54kg krb5kdc[29189](info): commencing operation
krb5kdc: starting...
W20260923 14:42:25.205094 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:42:25 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:42:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:42:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/rangeradmin_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/rangeradmin_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/rangerlookup_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/rangerlookup_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
I20260923 14:42:25.367170 17426 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskUR6fzw/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/postgres -l logfile start
2026-09-23 14:42:27.832 UTC [29219] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 14:42:27.832 UTC [29219] LOG: listening on IPv4 address "127.17.4.148", port 42771
2026-09-23 14:42:27.835 UTC [29219] LOG: listening on Unix socket "/tmp/.s.PGSQL.42771"
2026-09-23 14:42:27.869 UTC [29222] LOG: database system was shut down at 2026-09-23 14:42:26 UTC
2026-09-23 14:42:27.873 UTC [29219] LOG: database system is ready to accept connections
I20260923 14:42:28.816855 17426 mini_postgres.cc:96] Postgres bound to 42771
2026-09-23 14:42:28.823 UTC [29230] FATAL: database "slave" does not exist
127.17.4.148:42771 - accepting connections
I20260923 14:42:28.824092 17426 mini_ranger.cc:161] Starting Ranger...
I20260923 14:42:28.839228 17426 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 14:42:29.301393 17426 mini_ranger.cc:87] Created ranger Postgres database
I20260923 14:42:29.301478 17426 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-admin
2026-09-23 14:42:29,578 [I] DB FLAVOR :POSTGRES
2026-09-23 14:42:29,579 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 14:42:29,579 [I] Checking connection..
2026-09-23 14:42:29,579 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 14:42:29,821 [I] Checking connection passed.
2026-09-23 14:42:29,822 [I] --------- Verifying version history table ---------
2026-09-23 14:42:29,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 14:42:30,051 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 14:42:30,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 14:42:30,302 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 14:42:30,302 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 14:42:30,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 14:42:30.557 UTC [29294] WARNING: there is no transaction in progress
2026-09-23 14:42:30,563 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 14:42:30,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 14:42:30,808 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 14:42:30,808 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 14:42:30,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 14:42:31,050 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 14:42:31,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-54kg.c.gcp-upstream.internal','N') ;"
2026-09-23 14:42:31,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 14:42:31,830 [I] Table x_portal_user does not exist in database ranger
2026-09-23 14:42:31,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 14:42:32,062 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 14:42:32,062 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 14:42:32,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 14:42:32,530 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 14:42:32,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 14:42:33.448 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.464 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.480 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.494 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.510 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.529 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.592 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.599 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.613 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.622 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.632 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.645 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.655 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.661 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.667 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:33.673 UTC [29402] WARNING: there is no transaction in progress
2026-09-23 14:42:34,272 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 14:42:34,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 14:42:34,522 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 14:42:34,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 14:42:34,763 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 14:42:34,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 14:42:35,008 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 14:42:35,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 14:42:35,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 14:42:35,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-54kg.c.gcp-upstream.internal';"
2026-09-23 14:42:35,756 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 14:42:35,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 14:42:36,017 [I] DB_PATCHES have already been applied
I20260923 14:42:36.023351 17426 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-admin:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskUR6fzw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 14:42:36.023435 17426 mini_ranger.cc:193] Using host: 127.17.4.148
I20260923 14:42:36.026901 17426 mini_ranger.cc:227] Ranger admin URL: http://127.17.4.148:56919
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 2:42:36 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 14:42:37.129978 17426 mini_ranger.cc:160] Time spent starting Ranger: real 8.306s user 0.000s sys 0.010s
Sep 23, 2026 2:42:57 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 2:42:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 23, 2026 2:42:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 2:42:58 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 2:42:58 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 14:42:59.530740 17426 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.4.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.4.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/rangerkms_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.4.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/rangerkms_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.4.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.4.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.4.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/HTTP_127.17.4.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 14:42:59 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174579, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 14:42:59.623420 17426 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 14:42:59.633507 17426 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 14:43:00.454777 17426 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 14:43:00.454849 17426 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms
I20260923 14:43:00.454864 17426 mini_ranger_kms.cc:227] Using postgres at 127.17.4.148:42771
2026-09-23 14:43:00,629 [I] DB FLAVOR :POSTGRES
2026-09-23 14:43:00,629 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 14:43:00,629 [I] Checking connection
2026-09-23 14:43:00,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 14:43:00,899 [I] connection success
2026-09-23 14:43:00,899 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 14:43:00,899 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 14:43:00,899 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 14:43:01,153 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 14:43:01,153 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 14:43:01,153 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 14:43:01,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.4.148:42771/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 14:43:01,425 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 14:43:01.888574 17426 mini_ranger_kms.cc:310] Created kms service
I20260923 14:43:02.085757 17426 mini_ranger_kms.cc:326] Created kudu user
I20260923 14:43:02.127440 17426 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 14:43:02 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174579, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:02.495091 17426 mini_ranger_kms.cc:384] Added ranger policy
I20260923 14:43:02.495358 17426 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms:/tmp/dist-test-taskUR6fzw/build/debug/bin/postgresql.jar:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskUR6fzw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 14:43:02.495389 17426 mini_ranger_kms.cc:240] Using host: 127.17.4.148
I20260923 14:43:02.499823 17426 mini_ranger_kms.cc:276] Ranger KMS PID: 29582
I20260923 14:43:02.499902 17426 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.4.148:38351
Sep 23, 2026 2:43:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 2:43:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 2:43:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 2:43:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 2:43:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 2:43:03 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260923 14:43:04.753888 17426 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.130s user 0.017s sys 0.141s
I20260923 14:43:04.754022 17426 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 14:43:04.754091 17426 mini_ranger_kms.cc:401] 127.17.4.148:38351/kms/v1/keys
Sep 23 14:43:04 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790174584, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.4.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 23 14:43:05 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174584, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.4.148@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
Sep 23 14:43:05 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174584, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.4.148@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
Sep 23 14:43:07 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:43:07.839901 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39167
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39167
--ranger_config_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:07.947105 29633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:07.947361 29633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:07.947444 29633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:07.951412 29633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:07.951468 29633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:07.951488 29633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:07.951502 29633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:07.951516 29633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:07.956826 29633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.4.148:38351/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39167
--ranger_config_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:07.957854 29633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:07.958885 29633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:07.967530 29641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:07.967485 29638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:07.967658 29633 server_base.cc:1034] running on GCE node
W20260923 14:43:07.967506 29639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:07.968425 29633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:07.969468 29633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:07.970629 29633 hybrid_clock.cc:648] HybridClock initialized: now 1790174587970612 us; error 30 us; skew 500 ppm
Sep 23 14:43:07 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174587, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:07.973345 29633 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:07.974310 29633 webserver.cc:460] Webserver started at http://127.17.4.190:37501/ using document root <none> and password file <none>
I20260923 14:43:07.974815 29633 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:07.974870 29633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:07.975050 29633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:43:07 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174587, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:08.031163 29633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "85d87e0f230148f59968e1aeb61b72b5"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "79f7833f407a5896653f85ca8f75c7ab"
server_key_iv: "76428597111dad9b9cc91e57d802ccc8"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:08.031984 29633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "85d87e0f230148f59968e1aeb61b72b5"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "79f7833f407a5896653f85ca8f75c7ab"
server_key_iv: "76428597111dad9b9cc91e57d802ccc8"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:08.037101 29633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 14:43:08.055310 29648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:08.056964 29633 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260923 14:43:08.057077 29633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "85d87e0f230148f59968e1aeb61b72b5"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "79f7833f407a5896653f85ca8f75c7ab"
server_key_iv: "76428597111dad9b9cc91e57d802ccc8"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:08.057184 29633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:08.086285 29633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:08.089319 29633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:08.089488 29633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:08.096486 29633 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:39167
I20260923 14:43:08.096517 29700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:39167 every 8 connection(s)
I20260923 14:43:08.097470 29633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:08.100258 29701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:08.105783 29701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Bootstrap starting.
I20260923 14:43:08.107061 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 29633
I20260923 14:43:08.107199 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:43:08.107498 17426 external_mini_cluster.cc:1428] Setting key 53dda9156a5072bc4f15afe0a55fed81
I20260923 14:43:08.108376 29701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:08.109261 29701 log.cc:824] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:08.111174 29701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: No bootstrap required, opened a new log
I20260923 14:43:08.114488 29701 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:08.114734 29701 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:08.114815 29701 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d87e0f230148f59968e1aeb61b72b5, State: Initialized, Role: FOLLOWER
I20260923 14:43:08.115258 29701 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:08.115407 29701 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:08.115473 29701 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:08.115572 29701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 0 FOLLOWER]: Advancing to term 1
Sep 23 14:43:08 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:08.116528 29701 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:08.116881 29701 leader_election.cc:302] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85d87e0f230148f59968e1aeb61b72b5; no voters:
I20260923 14:43:08.117204 29701 leader_election.cc:288] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:43:08.117267 29706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:08.117453 29706 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 LEADER]: Becoming Leader. State: Replica: 85d87e0f230148f59968e1aeb61b72b5, State: Running, Role: LEADER
I20260923 14:43:08.117791 29706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:08.118459 29701 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:08.120537 29707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d87e0f230148f59968e1aeb61b72b5. Latest consensus state: current_term: 1 leader_uuid: "85d87e0f230148f59968e1aeb61b72b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } } }
I20260923 14:43:08.120738 29707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:08.120764 29701 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 14:43:08.120944 29708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85d87e0f230148f59968e1aeb61b72b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } } }
I20260923 14:43:08.121052 29708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:08.121182 29721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:08.124495 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:08.108655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33546 (local address 127.17.4.190:39167)
0923 14:43:08.109120 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:08.109135 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:08.109169 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:43:08.109854 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:08.109872 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:08.110193 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:08.110550 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:08.111329 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:08.112395 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:08.113221 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:08.113671 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:08.113839 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:08.116691 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:08.116698 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:08.116714 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:08.116745 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:08.118556 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:08.119267 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:08.119275 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:08.119280 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:08.119412 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:08.119805 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:08.119808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:08.119810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:08.120295 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:08.120488 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:08.121227 (+ 739us) server_negotiation.cc:299] Negotiation successful
0923 14:43:08.121532 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":140,"threads_started":1}
I20260923 14:43:08.128479 29721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:08.135403 29721 catalog_manager.cc:1347] Generated new cluster ID: 4e76c075243d477f88c490f3540ba14e
I20260923 14:43:08.135555 29721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:08.142719 29721 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:43:08.143987 29721 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:08.154505 29721 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Generated new TSK 0
I20260923 14:43:08.155267 29721 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:43:08.823063 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39167
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:08.938136 29746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:08.938542 29746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:08.938655 29746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:08.942708 29746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:08.942796 29746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:08.942907 29746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:43:08.948066 29746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.4.148:38351/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:08.949708 29746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:08.950763 29746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:08.960981 29752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:08.961120 29754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:08.961166 29751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:08.961357 29746 server_base.cc:1034] running on GCE node
I20260923 14:43:08.961807 29746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:08.962571 29746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:08.963793 29746 hybrid_clock.cc:648] HybridClock initialized: now 1790174588963756 us; error 55 us; skew 500 ppm
Sep 23 14:43:08 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174588, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:08.967269 29746 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:43:08.968238 29746 webserver.cc:460] Webserver started at http://127.17.4.129:43177/ using document root <none> and password file <none>
I20260923 14:43:08.968716 29746 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:08.968760 29746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:08.969027 29746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:43:08 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174588, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:08.987686 29746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "e2806e211dfb4e6aab5d8f42b45395cb"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "81b358754cbefcd9d55b7b295d8f16c0"
server_key_iv: "396edf938a8d4f9593f153343e595cf1"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:08.988456 29746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "e2806e211dfb4e6aab5d8f42b45395cb"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "81b358754cbefcd9d55b7b295d8f16c0"
server_key_iv: "396edf938a8d4f9593f153343e595cf1"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:08.995469 29746 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260923 14:43:09.014832 29763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.016737 29746 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 14:43:09.016887 29746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "e2806e211dfb4e6aab5d8f42b45395cb"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "81b358754cbefcd9d55b7b295d8f16c0"
server_key_iv: "396edf938a8d4f9593f153343e595cf1"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.017035 29746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:09.038527 29746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:09.042310 29746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:09.042516 29746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:09.043231 29746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:09.044304 29746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:09.044380 29746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.044442 29746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:09.044471 29746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.057909 29746 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:37707
I20260923 14:43:09.058818 29746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:43:09.059654 29876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:37707 every 8 connection(s)
I20260923 14:43:09.062707 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 29746
I20260923 14:43:09.062816 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:43:09.063119 17426 external_mini_cluster.cc:1428] Setting key ab99725f6694d6f3ff71510377a53cea
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174588, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:09.077180 29879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:09.061505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39167 (local address 127.17.4.129:42745)
0923 14:43:09.062002 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:09.062045 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:09.062876 (+ 831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:09.064423 (+ 1547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:09.064432 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:09.064838 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:09.065324 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:09.065349 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.066327 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.066331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:09.067857 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:09.067872 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.068637 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.068643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:09.068881 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:09.069651 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:09.069677 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:09.071413 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:09.073821 (+ 2408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:09.073827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:09.073842 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:09.074187 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:09.074512 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:09.074515 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:09.074517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:09.074686 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:09.075183 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:09.075191 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:09.075528 (+ 337us) client_negotiation.cc:769] Sending connection context
0923 14:43:09.075724 (+ 196us) client_negotiation.cc:240] Negotiation successful
0923 14:43:09.076091 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":150,"threads_started":1}
I20260923 14:43:09.078168 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:09.063712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:42745 (local address 127.17.4.190:39167)
0923 14:43:09.064011 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:09.064019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:09.064033 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:43:09.064069 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:09.064071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:09.064110 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:09.065488 (+ 1378us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:09.065627 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.066197 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.068015 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.068454 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.069268 (+ 814us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:09.071640 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:09.071644 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:09.071647 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:09.071682 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:09.073596 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:09.074317 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:09.074321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:09.074322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:09.074418 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:09.074825 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:09.074828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:09.074830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:09.075058 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:09.077796 (+ 2738us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:09.077885 (+ 89us) server_negotiation.cc:299] Negotiation successful
0923 14:43:09.078009 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":129,"threads_started":1}
I20260923 14:43:09.080865 29877 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39167
I20260923 14:43:09.081104 29877 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:09.081676 29877 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:09.083395 29665 ts_manager.cc:194] Registered new tserver with Master: e2806e211dfb4e6aab5d8f42b45395cb (127.17.4.129:37707)
I20260923 14:43:09.084957 29665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:42745
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:43:09.121505 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39167
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 14:43:09.274832 29885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:09.275214 29885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:09.275286 29885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:09.281332 29885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:09.281454 29885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:09.281572 29885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:43:09.289273 29885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.4.148:38351/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:09.290783 29885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:09.292140 29885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:09.304111 29891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:09.304117 29894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:09.304580 29892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:09.305536 29885 server_base.cc:1034] running on GCE node
I20260923 14:43:09.306010 29885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:09.306852 29885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:09.308043 29885 hybrid_clock.cc:648] HybridClock initialized: now 1790174589308017 us; error 37 us; skew 500 ppm
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:09.311975 29885 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:43:09.313031 29885 webserver.cc:460] Webserver started at http://127.17.4.130:43543/ using document root <none> and password file <none>
I20260923 14:43:09.313740 29885 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:09.313829 29885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:09.314049 29885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:09.335615 29885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "8fa9718537864731b0088d7b716c1bb8"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "7a6f449ab8792add6420b305cb1d5480"
server_key_iv: "bcab96e298307a49bcf9ac7ea6aee47a"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.340898 29885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "8fa9718537864731b0088d7b716c1bb8"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "7a6f449ab8792add6420b305cb1d5480"
server_key_iv: "bcab96e298307a49bcf9ac7ea6aee47a"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.346663 29885 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 14:43:09.373201 29901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.375281 29885 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.000s
I20260923 14:43:09.375432 29885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "8fa9718537864731b0088d7b716c1bb8"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "7a6f449ab8792add6420b305cb1d5480"
server_key_iv: "bcab96e298307a49bcf9ac7ea6aee47a"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.375595 29885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:09.400290 29885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:09.403385 29885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:09.403585 29885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:09.404275 29885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:09.405221 29885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:09.405288 29885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.405355 29885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:09.405405 29885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.416894 29885 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:42185
I20260923 14:43:09.416935 30014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:42185 every 8 connection(s)
I20260923 14:43:09.417872 29885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:43:09.421587 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 29885
I20260923 14:43:09.421720 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:43:09.422043 17426 external_mini_cluster.cc:1428] Setting key 50456eb0925300f74e0a992fe1377eaa
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:09.462014 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:09.419938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:34893 (local address 127.17.4.190:39167)
0923 14:43:09.420140 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:09.420146 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:09.421025 (+ 879us) server_negotiation.cc:407] Connection header received
0923 14:43:09.422341 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:09.422345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:09.422407 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:09.422471 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:09.424157 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.424972 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.426887 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.427300 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.427374 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:09.454221 (+ 26847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:09.454225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:09.454228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:09.454267 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:09.456228 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:09.459939 (+ 3711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:09.459943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:09.459945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:09.460042 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:09.460532 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:09.460535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:09.460537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:09.460801 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:09.460888 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:09.461687 (+ 799us) server_negotiation.cc:299] Negotiation successful
0923 14:43:09.461837 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260923 14:43:09.464056 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:09.420378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39167 (local address 127.17.4.130:34893)
0923 14:43:09.420865 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:09.420918 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:09.422059 (+ 1141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:09.422944 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:09.422953 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:09.423251 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:09.423961 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:09.423982 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.425185 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.425191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:09.426733 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:09.426746 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.427546 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.427549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:09.427694 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:09.428426 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:09.428443 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:09.453927 (+ 25484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:09.456412 (+ 2485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:09.456420 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:09.456440 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:09.456896 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:09.460163 (+ 3267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:09.460166 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:09.460176 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:09.460410 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:09.460957 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:09.460963 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:09.461381 (+ 418us) client_negotiation.cc:769] Sending connection context
0923 14:43:09.462497 (+ 1116us) client_negotiation.cc:240] Negotiation successful
0923 14:43:09.462875 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":165,"threads_started":1}
I20260923 14:43:09.467494 30015 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39167
I20260923 14:43:09.467788 30015 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:09.468365 30015 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:09.469544 29665 ts_manager.cc:194] Registered new tserver with Master: 8fa9718537864731b0088d7b716c1bb8 (127.17.4.130:42185)
I20260923 14:43:09.470322 29665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:34893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:43:09.490940 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39167
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
W20260923 14:43:09.677874 30020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:09.678243 30020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:09.678306 30020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:09.684391 30020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:09.684468 30020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:09.684552 30020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:43:09.692265 30020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.4.148:38351/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:09.693600 30020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:09.694933 30020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:09.708006 30028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:09.708459 30026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:09.711015 30025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:09.712006 30020 server_base.cc:1034] running on GCE node
I20260923 14:43:09.712528 30020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:09.713663 30020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:09.720678 30020 hybrid_clock.cc:648] HybridClock initialized: now 1790174589720597 us; error 95 us; skew 500 ppm
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:09.724433 30020 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:43:09.725533 30020 webserver.cc:460] Webserver started at http://127.17.4.131:37221/ using document root <none> and password file <none>
I20260923 14:43:09.726248 30020 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:09.726365 30020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:09.726610 30020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:09.740980 30020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "d214c329c20185cecb64143fef600014"
server_key_iv: "17b1dba85579ca2bd4229054c7f45638"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.741756 30020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "d214c329c20185cecb64143fef600014"
server_key_iv: "17b1dba85579ca2bd4229054c7f45638"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.757603 30020 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.004s sys 0.000s
I20260923 14:43:09.779539 30035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.789108 30020 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.001s sys 0.000s
I20260923 14:43:09.789288 30020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "d214c329c20185cecb64143fef600014"
server_key_iv: "17b1dba85579ca2bd4229054c7f45638"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:09.789459 30020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:09.829677 30020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:09.833423 30020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:09.833624 30020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:09.834245 30020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:09.835196 30020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:09.835253 30020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.835306 30020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:09.835333 30020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:09.847385 30020 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:42639
I20260923 14:43:09.848580 30020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:43:09.849826 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30020
I20260923 14:43:09.849931 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:43:09.850204 17426 external_mini_cluster.cc:1428] Setting key f83ee903e82bafe4e14e3e15c54a2a3e
I20260923 14:43:09.853416 30148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:42639 every 8 connection(s)
Sep 23 14:43:09 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174589, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:09.876757 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:09.856013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:59959 (local address 127.17.4.190:39167)
0923 14:43:09.856147 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:09.856160 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:09.860342 (+ 4182us) server_negotiation.cc:407] Connection header received
0923 14:43:09.861838 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:09.861842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:09.861896 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:09.861952 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:09.865398 (+ 3446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.866184 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.867885 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.868206 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.868274 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:09.871353 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:09.871357 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:09.871359 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:09.871386 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:09.873072 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:09.873646 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:09.873650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:09.873651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:09.873747 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:09.874099 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:09.874102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:09.874104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:09.874323 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:09.874398 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:09.876446 (+ 2048us) server_negotiation.cc:299] Negotiation successful
0923 14:43:09.876559 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:43:09.878681 30151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:09.855339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39167 (local address 127.17.4.131:59959)
0923 14:43:09.860197 (+ 4858us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:09.860254 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:09.861527 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:09.862400 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:09.862409 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:09.862927 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:09.865236 (+ 2309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:09.865259 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.866329 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.866332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:09.867737 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:09.867748 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:09.868460 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:09.868463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:09.868653 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:09.869323 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:09.869342 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:09.871179 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:09.873212 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:09.873218 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:09.873234 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:09.873534 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:09.873844 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:09.873847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:09.873849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:09.874004 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:09.874463 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:09.874468 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:09.876177 (+ 1709us) client_negotiation.cc:769] Sending connection context
0923 14:43:09.877229 (+ 1052us) client_negotiation.cc:240] Negotiation successful
0923 14:43:09.877552 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4587,"thread_start_us":198,"threads_started":1}
I20260923 14:43:09.880883 30149 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39167
I20260923 14:43:09.881131 30149 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:09.881726 30149 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:09.882952 29665 ts_manager.cc:194] Registered new tserver with Master: 2ee1e6ab9eea4d76b7b82cec4db6a747 (127.17.4.131:42639)
I20260923 14:43:09.883668 29665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:59959
I20260923 14:43:09.887320 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:43:09.888207 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 29746
I20260923 14:43:09.897687 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 29885
I20260923 14:43:09.906153 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30020
I20260923 14:43:09.912938 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 29633
I20260923 14:43:09.920511 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39167
--webserver_interface=127.17.4.190
--webserver_port=37501
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39167
--ranger_config_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:10.035918 30152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:10.036180 30152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:10.036224 30152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:10.040149 30152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:10.040201 30152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:10.040220 30152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:10.040236 30152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:10.040251 30152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:10.046058 30152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39167
--ranger_config_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=37501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:10.046967 30152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:10.047901 30152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:10.056025 30158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:10.056068 30152 server_base.cc:1034] running on GCE node
W20260923 14:43:10.056071 30160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:10.056222 30157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:10.056788 30152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:10.057897 30152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:10.059101 30152 hybrid_clock.cc:648] HybridClock initialized: now 1790174590059077 us; error 46 us; skew 500 ppm
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:10.062445 30152 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:10.063318 30152 webserver.cc:460] Webserver started at http://127.17.4.190:37501/ using document root <none> and password file <none>
I20260923 14:43:10.063911 30152 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:10.064005 30152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:10.142179 30152 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:43:10.144377 30168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.145596 30152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:43:10.145738 30152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "85d87e0f230148f59968e1aeb61b72b5"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "79f7833f407a5896653f85ca8f75c7ab"
server_key_iv: "76428597111dad9b9cc91e57d802ccc8"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:10.146270 30152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:10.160880 30152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:10.163305 30152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:10.163499 30152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:10.171192 30152 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:39167
I20260923 14:43:10.171196 30220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:39167 every 8 connection(s)
I20260923 14:43:10.172235 30152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:10.176339 30221 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:43:10.177872 30221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Bootstrap starting.
I20260923 14:43:10.181190 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30152
I20260923 14:43:10.181674 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:37707
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:39167
--webserver_port=43177
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:10.197376 30221 log.cc:824] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:10.203704 30221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:43:10.204128 30221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Bootstrap complete.
I20260923 14:43:10.208415 30221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:10.208773 30221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d87e0f230148f59968e1aeb61b72b5, State: Initialized, Role: FOLLOWER
I20260923 14:43:10.209247 30221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:10.209358 30221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:10.209446 30221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:10.209544 30221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 1 FOLLOWER]: Advancing to term 2
I20260923 14:43:10.211349 30221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:10.211670 30221 leader_election.cc:302] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85d87e0f230148f59968e1aeb61b72b5; no voters:
I20260923 14:43:10.212039 30221 leader_election.cc:288] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 14:43:10.212100 30225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 14:43:10.212355 30225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [term 2 LEADER]: Becoming Leader. State: Replica: 85d87e0f230148f59968e1aeb61b72b5, State: Running, Role: LEADER
I20260923 14:43:10.212632 30225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } }
I20260923 14:43:10.213280 30221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:10.213517 30227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "85d87e0f230148f59968e1aeb61b72b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } } }
I20260923 14:43:10.213649 30227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:10.213965 30226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85d87e0f230148f59968e1aeb61b72b5. Latest consensus state: current_term: 2 leader_uuid: "85d87e0f230148f59968e1aeb61b72b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85d87e0f230148f59968e1aeb61b72b5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39167 } } }
I20260923 14:43:10.214071 30226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:10.214478 30229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:10.217676 30229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:10.218235 30221 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 14:43:10.218264 30229 catalog_manager.cc:1259] Loaded cluster ID: 4e76c075243d477f88c490f3540ba14e
I20260923 14:43:10.218454 30229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:10.223871 30229 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:10.225378 30229 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Loaded TSK: 0
I20260923 14:43:10.226872 30229 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 14:43:10.310768 30223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:10.311117 30223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:10.311184 30223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:10.316308 30223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:10.316376 30223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:10.316465 30223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:43:10.321926 30223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:37707
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=43177
--tserver_master_addrs=127.17.4.190:39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:10.323056 30223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:10.324221 30223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:10.336509 30259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:10.336944 30261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:10.337181 30258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:10.337567 30223 server_base.cc:1034] running on GCE node
I20260923 14:43:10.338023 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:10.338687 30223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:10.339870 30223 hybrid_clock.cc:648] HybridClock initialized: now 1790174590339833 us; error 46 us; skew 500 ppm
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:10.342743 30223 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:43:10.343755 30223 webserver.cc:460] Webserver started at http://127.17.4.129:43177/ using document root <none> and password file <none>
I20260923 14:43:10.344355 30223 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:10.344461 30223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:10.367575 30223 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 14:43:10.370868 30270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.372525 30223 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260923 14:43:10.372669 30223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "e2806e211dfb4e6aab5d8f42b45395cb"
format_stamp: "Formatted at 2026-09-23 14:43:08 on dist-test-slave-54kg"
server_key: "81b358754cbefcd9d55b7b295d8f16c0"
server_key_iv: "396edf938a8d4f9593f153343e595cf1"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:10.373435 30223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:10.406805 30223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:10.411302 30223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:10.411495 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:10.412143 30223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:10.413122 30223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:10.413187 30223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.413246 30223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:10.413272 30223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.425377 30223 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:37707
I20260923 14:43:10.425462 30385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:37707 every 8 connection(s)
I20260923 14:43:10.426440 30223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:43:10.433305 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30223
I20260923 14:43:10.433801 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:42185
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:39167
--webserver_port=43543
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:10.446307 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.428690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:59809 (local address 127.17.4.190:39167)
0923 14:43:10.429230 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:10.429261 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:10.429770 (+ 509us) server_negotiation.cc:407] Connection header received
0923 14:43:10.431049 (+ 1279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:10.431060 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:10.431350 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:10.431682 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:10.432794 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.434374 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.436198 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.436945 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.437086 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:10.440122 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:10.440128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:10.440145 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:10.440178 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:10.442332 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:10.442965 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:10.442973 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:10.442978 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:10.443113 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:10.443529 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:10.443532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:10.443534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:10.444037 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:10.444160 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:10.444907 (+ 747us) server_negotiation.cc:299] Negotiation successful
0923 14:43:10.445237 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":87,"threads_started":1}
I20260923 14:43:10.447973 30389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.428906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39167 (local address 127.17.4.129:59809)
0923 14:43:10.429590 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:10.429632 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:10.430628 (+ 996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:10.431783 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:10.431792 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:10.432126 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:10.432620 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:10.432634 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.434549 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.434556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:10.436045 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:10.436058 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.437366 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.437370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:10.437561 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:10.438313 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:10.438335 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:10.439886 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:10.442472 (+ 2586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:10.442478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:10.442492 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:10.442825 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:10.443241 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:10.443244 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:10.443246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:10.443409 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:10.444243 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:10.444249 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:10.444531 (+ 282us) client_negotiation.cc:769] Sending connection context
0923 14:43:10.446784 (+ 2253us) client_negotiation.cc:240] Negotiation successful
0923 14:43:10.447093 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":145,"threads_started":1}
I20260923 14:43:10.450875 30386 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39167
I20260923 14:43:10.451121 30386 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:10.451750 30386 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
W20260923 14:43:10.454039 30386 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:39167 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 14:43:10.454165 30386 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:10.454347 30386 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:10.455159 30386 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:10.455334 30386 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
W20260923 14:43:10.456106 30386 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 14:43:10.578238 30390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:10.578682 30390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:10.578768 30390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:10.584791 30390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:10.584873 30390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:10.584959 30390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:43:10.592638 30390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:42185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=43543
--tserver_master_addrs=127.17.4.190:39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:10.593990 30390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:10.595335 30390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:10.606330 30395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:10.606349 30398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:10.606618 30396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:10.607081 30390 server_base.cc:1034] running on GCE node
I20260923 14:43:10.607525 30390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:10.608348 30390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:10.609548 30390 hybrid_clock.cc:648] HybridClock initialized: now 1790174590609523 us; error 38 us; skew 500 ppm
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:10.613314 30390 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:43:10.614418 30390 webserver.cc:460] Webserver started at http://127.17.4.130:43543/ using document root <none> and password file <none>
I20260923 14:43:10.615127 30390 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:10.615236 30390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:10.637018 30390 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.000s sys 0.003s
I20260923 14:43:10.640648 30406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.642211 30390 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260923 14:43:10.642385 30390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "8fa9718537864731b0088d7b716c1bb8"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "7a6f449ab8792add6420b305cb1d5480"
server_key_iv: "bcab96e298307a49bcf9ac7ea6aee47a"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:10.642982 30390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:10.685438 30390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:10.689321 30390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:10.689533 30390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:10.690212 30390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:10.691236 30390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:10.691308 30390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.691390 30390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:10.691422 30390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.702975 30390 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:42185
I20260923 14:43:10.704339 30390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:43:10.705181 30520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:42185 every 8 connection(s)
I20260923 14:43:10.712877 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30390
I20260923 14:43:10.713376 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.4.148:38351/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:42639
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:39167
--webserver_port=37221
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:10.723218 30523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.707890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39167 (local address 127.17.4.130:38323)
0923 14:43:10.708467 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:10.708525 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:10.709648 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:10.710277 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:10.710286 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:10.710659 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:10.711330 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:10.711368 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.712607 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.712611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:10.714090 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:10.714101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.714968 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.714972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:10.715204 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:10.715938 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:10.715958 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:10.717708 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:10.719904 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:10.719909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:10.719926 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:10.720266 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:10.720608 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:10.720612 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:10.720614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:10.720789 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:10.721281 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:10.721288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:10.721609 (+ 321us) client_negotiation.cc:769] Sending connection context
0923 14:43:10.721816 (+ 207us) client_negotiation.cc:240] Negotiation successful
0923 14:43:10.722159 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":141,"threads_started":1}
I20260923 14:43:10.724260 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.707374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:38323 (local address 127.17.4.190:39167)
0923 14:43:10.707521 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:10.707526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:10.708639 (+ 1113us) server_negotiation.cc:407] Connection header received
0923 14:43:10.709904 (+ 1265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:10.709908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:10.709973 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:10.710069 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:10.711527 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.712423 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.714240 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.714575 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.714659 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:10.717901 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:10.717905 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:10.717908 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:10.717937 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:10.719725 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:10.720408 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:10.720411 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:10.720414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:10.720503 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:10.720905 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:10.720909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:10.720911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:10.721132 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:10.721227 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:10.723972 (+ 2745us) server_negotiation.cc:299] Negotiation successful
0923 14:43:10.724108 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 14:43:10.725325 30521 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39167
I20260923 14:43:10.725576 30521 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:10.726131 30521 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
W20260923 14:43:10.727775 30521 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:39167 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 14:43:10.727895 30521 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:10.728060 30521 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:10.728864 30521 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:10.729046 30521 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
W20260923 14:43:10.729761 30521 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 14:43:10.878602 30524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:10.879004 30524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:10.879078 30524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:10.885267 30524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:10.885346 30524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:10.885434 30524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:43:10.893102 30524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.4.148:38351/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:42639
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=37221
--tserver_master_addrs=127.17.4.190:39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:10.894490 30524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:10.895936 30524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:10.908078 30530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:10.908291 30524 server_base.cc:1034] running on GCE node
W20260923 14:43:10.908901 30533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:10.909016 30531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:10.909551 30524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:10.910367 30524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:10.911576 30524 hybrid_clock.cc:648] HybridClock initialized: now 1790174590911555 us; error 36 us; skew 500 ppm
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:10.915409 30524 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:43:10.916499 30524 webserver.cc:460] Webserver started at http://127.17.4.131:37221/ using document root <none> and password file <none>
I20260923 14:43:10.917222 30524 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:10.917325 30524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:10.940105 30524 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 14:43:10.944144 30541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.945611 30524 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260923 14:43:10.945765 30524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747"
format_stamp: "Formatted at 2026-09-23 14:43:09 on dist-test-slave-54kg"
server_key: "d214c329c20185cecb64143fef600014"
server_key_iv: "17b1dba85579ca2bd4229054c7f45638"
server_key_version: "kuduclusterkey@0"
I20260923 14:43:10.946422 30524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:10.962939 30524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:10.966300 30524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:10.966495 30524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:10.967218 30524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:10.968276 30524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:10.968381 30524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.968477 30524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:10.968539 30524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:10.980278 30524 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:42639
I20260923 14:43:10.981679 30524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:43:10.983521 30655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:42639 every 8 connection(s)
I20260923 14:43:10.985303 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30524
Sep 23 14:43:10 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174590, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:11.000115 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.985381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:58909 (local address 127.17.4.190:39167)
0923 14:43:10.985543 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:10.985549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:10.986963 (+ 1414us) server_negotiation.cc:407] Connection header received
0923 14:43:10.989512 (+ 2549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:10.989516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:10.989567 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:10.989642 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:10.990799 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.991517 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.992672 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.992899 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.993015 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:10.995872 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:10.995876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:10.995878 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:10.995908 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:10.997814 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:10.998334 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:10.998337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:10.998339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:10.998423 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:10.998840 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:10.998844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:10.998846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:10.999050 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:10.999137 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:10.999829 (+ 692us) server_negotiation.cc:299] Negotiation successful
0923 14:43:10.999950 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260923 14:43:11.001675 30659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.985906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39167 (local address 127.17.4.131:58909)
0923 14:43:10.986818 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:10.986871 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:10.988327 (+ 1456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:10.989821 (+ 1494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:10.989828 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:10.990067 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:10.990625 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:10.990643 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.991647 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.991649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:10.992545 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:10.992555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.993049 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.993053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:10.993230 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:10.993848 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:10.993889 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:10.995643 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:10.997957 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:10.997963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:10.997975 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:10.998218 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:10.998532 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:10.998535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:10.998537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:10.998713 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:10.999218 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:10.999225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:10.999518 (+ 293us) client_negotiation.cc:769] Sending connection context
0923 14:43:11.000299 (+ 781us) client_negotiation.cc:240] Negotiation successful
0923 14:43:11.000650 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":164,"threads_started":1}
I20260923 14:43:11.003566 30656 heartbeater.cc:347] Connected to a master server at 127.17.4.190:39167
I20260923 14:43:11.003857 30656 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:11.004483 30656 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
W20260923 14:43:11.006132 30656 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:39167 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 14:43:11.006276 30656 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:11.006455 30656 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:11.007498 30656 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:11.007521 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:10.986334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33552 (local address 127.17.4.190:39167)
0923 14:43:10.986560 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:10.986565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:10.987257 (+ 692us) server_negotiation.cc:407] Connection header received
0923 14:43:10.987369 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:10.987373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:10.987428 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:10.987537 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:10.989451 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.990268 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.995293 (+ 5025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:10.995648 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:10.995796 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:11.002188 (+ 6392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:11.002192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:11.002195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:11.002219 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:11.004004 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:11.004548 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:11.004552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:11.004553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:11.004649 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:11.004967 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:11.004969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:11.004970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:11.005156 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:11.005391 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:11.007188 (+ 1797us) server_negotiation.cc:299] Negotiation successful
0923 14:43:11.007331 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":80,"threads_started":1}
I20260923 14:43:11.007668 30656 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
W20260923 14:43:11.008419 30656 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 23 14:43:11 dist-test-slave-54kg krb5kdc[29189](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790174591, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:11.456364 30386 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:11.456683 30386 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:11.457858 30185 ts_manager.cc:194] Registered new tserver with Master: e2806e211dfb4e6aab5d8f42b45395cb (127.17.4.129:37707)
I20260923 14:43:11.459518 30185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:59809
I20260923 14:43:11.730000 30521 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:11.730294 30521 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:11.732640 30185 ts_manager.cc:194] Registered new tserver with Master: 8fa9718537864731b0088d7b716c1bb8 (127.17.4.130:42185)
I20260923 14:43:11.733444 30185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:38323
Sep 23 14:43:11 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174591, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
Sep 23 14:43:11 dist-test-slave-54kg krb5kdc[29189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174591, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for HTTP/127.17.4.148@KRBTEST.COM
I20260923 14:43:12.008665 30656 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:12.008996 30656 heartbeater.cc:511] Master 127.17.4.190:39167 requested a full tablet report, sending...
I20260923 14:43:12.009961 30185 ts_manager.cc:194] Registered new tserver with Master: 2ee1e6ab9eea4d76b7b82cec4db6a747 (127.17.4.131:42639)
I20260923 14:43:12.010720 30185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:58909
I20260923 14:43:12.013192 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:43:12.039988 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.014842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33558 (local address 127.17.4.190:39167)
0923 14:43:12.015899 (+ 1057us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.015906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.015924 (+ 18us) server_negotiation.cc:407] Connection header received
0923 14:43:12.015978 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.015984 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.016041 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.016910 (+ 869us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:12.019681 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.021900 (+ 2219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.023546 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.023930 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.024025 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.032035 (+ 8010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:12.032040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:12.032043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:12.032083 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:12.036621 (+ 4538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:12.038168 (+ 1547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:12.038172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:12.038174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:12.038285 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:12.038593 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:12.038596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:12.038598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:12.038848 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:12.039565 (+ 717us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.039642 (+ 77us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.039812 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":908,"thread_start_us":69,"threads_started":1}
I20260923 14:43:12.044631 30185 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33558:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:43:12.049511 30185 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:43:12.080534 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.064027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42718 (local address 127.17.4.130:42185)
0923 14:43:12.068031 (+ 4004us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.068040 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.072466 (+ 4426us) server_negotiation.cc:407] Connection header received
0923 14:43:12.072572 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.072580 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.072857 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.073025 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:12.074510 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.075825 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.077573 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.079423 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.079528 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.079685 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.080256 (+ 571us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.080365 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3866,"thread_start_us":66,"threads_started":1}
I20260923 14:43:12.081255 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.063572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:42185 (local address 127.0.0.1:42718)
0923 14:43:12.072204 (+ 8632us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:12.072219 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:12.072339 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:12.073133 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:12.073141 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:12.074170 (+ 1029us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:12.074350 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.074359 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.075972 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.075975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.077412 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.077425 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.079783 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.079788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.079904 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.079948 (+ 44us) client_negotiation.cc:769] Sending connection context
0923 14:43:12.080065 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 14:43:12.081105 (+ 1040us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8561,"thread_start_us":133,"threads_started":1}
I20260923 14:43:12.084815 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.064464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37707 (local address 127.0.0.1:37218)
0923 14:43:12.074197 (+ 9733us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:12.074211 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:12.074295 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:12.078728 (+ 4433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:12.078732 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:12.078753 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:12.078859 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.078865 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.080499 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.080502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.081697 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.081709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.084383 (+ 2674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.084387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.084486 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.084511 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 14:43:12.084580 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 14:43:12.084657 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9668,"thread_start_us":79,"threads_started":1}
I20260923 14:43:12.085430 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.065021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.17.4.129:37707)
0923 14:43:12.072037 (+ 7016us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.072046 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.074576 (+ 2530us) server_negotiation.cc:407] Connection header received
0923 14:43:12.074661 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.074666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.074859 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.074989 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:12.079011 (+ 4022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.080350 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.081863 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.082679 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.082808 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.082944 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.085121 (+ 2177us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.085290 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6877,"thread_start_us":414,"threads_started":1}
I20260923 14:43:12.086222 30454 tablet_service.cc:1467] Processing CreateTablet for tablet e84738920f98431c9daec96e36d0080b (DEFAULT_TABLE table=test-table [id=845380688f714243bf9bb89548cff8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:12.087607 30454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e84738920f98431c9daec96e36d0080b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:12.091553 30319 tablet_service.cc:1467] Processing CreateTablet for tablet e84738920f98431c9daec96e36d0080b (DEFAULT_TABLE table=test-table [id=845380688f714243bf9bb89548cff8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:12.092736 30319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e84738920f98431c9daec96e36d0080b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:12.100453 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.063545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:42639 (local address 127.0.0.1:54070)
0923 14:43:12.068341 (+ 4796us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:12.068414 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:12.068566 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:12.073962 (+ 5396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:12.073966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:12.074376 (+ 410us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:12.074464 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.074469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.085900 (+ 11431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.085904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.087151 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.087164 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.099970 (+ 12806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.099975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.100104 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.100137 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 14:43:12.100193 (+ 56us) client_negotiation.cc:240] Negotiation successful
0923 14:43:12.100284 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4579,"spinlock_wait_cycles":884608,"thread_start_us":154,"threads_started":1}
I20260923 14:43:12.101305 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.064492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54070 (local address 127.17.4.131:42639)
0923 14:43:12.073349 (+ 8857us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.073356 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.073381 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:43:12.073458 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.073463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.073658 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.073809 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:12.083028 (+ 9219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.084243 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.087339 (+ 3096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.088285 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.100772 (+ 12487us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.100971 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.101037 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.101162 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8739,"thread_start_us":72,"threads_started":1}
I20260923 14:43:12.104661 30588 tablet_service.cc:1467] Processing CreateTablet for tablet e84738920f98431c9daec96e36d0080b (DEFAULT_TABLE table=test-table [id=845380688f714243bf9bb89548cff8ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:12.105945 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e84738920f98431c9daec96e36d0080b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:12.113461 30692 tablet_bootstrap.cc:492] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: Bootstrap starting.
I20260923 14:43:12.114508 30691 tablet_bootstrap.cc:492] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Bootstrap starting.
I20260923 14:43:12.116683 30692 tablet_bootstrap.cc:654] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:12.118861 30691 tablet_bootstrap.cc:654] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:12.119685 30691 log.cc:824] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:12.120594 30692 log.cc:824] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:12.128237 30693 tablet_bootstrap.cc:492] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Bootstrap starting.
I20260923 14:43:12.130671 30692 tablet_bootstrap.cc:492] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: No bootstrap required, opened a new log
I20260923 14:43:12.130894 30693 tablet_bootstrap.cc:654] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:12.130987 30692 ts_tablet_manager.cc:1397] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260923 14:43:12.134991 30692 raft_consensus.cc:348] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.136919 30693 log.cc:824] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:12.137559 30691 tablet_bootstrap.cc:492] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: No bootstrap required, opened a new log
I20260923 14:43:12.137928 30691 ts_tablet_manager.cc:1397] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260923 14:43:12.142104 30691 raft_consensus.cc:348] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.142510 30692 raft_consensus.cc:374] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:12.142623 30692 raft_consensus.cc:729] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2806e211dfb4e6aab5d8f42b45395cb, State: Initialized, Role: FOLLOWER
I20260923 14:43:12.143258 30692 consensus_queue.cc:260] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.145267 30692 ts_tablet_manager.cc:1428] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260923 14:43:12.145401 30691 raft_consensus.cc:374] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:12.145499 30691 raft_consensus.cc:729] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa9718537864731b0088d7b716c1bb8, State: Initialized, Role: FOLLOWER
I20260923 14:43:12.146039 30691 consensus_queue.cc:260] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.146497 30693 tablet_bootstrap.cc:492] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: No bootstrap required, opened a new log
I20260923 14:43:12.146777 30693 ts_tablet_manager.cc:1397] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.000s
I20260923 14:43:12.148092 30386 heartbeater.cc:503] Master 127.17.4.190:39167 was elected leader, sending a full tablet report...
I20260923 14:43:12.151325 30693 raft_consensus.cc:348] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.151711 30693 raft_consensus.cc:374] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:12.151929 30693 raft_consensus.cc:729] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ee1e6ab9eea4d76b7b82cec4db6a747, State: Initialized, Role: FOLLOWER
I20260923 14:43:12.152194 30691 ts_tablet_manager.cc:1428] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260923 14:43:12.152482 30693 consensus_queue.cc:260] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.153609 30693 ts_tablet_manager.cc:1428] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260923 14:43:12.154000 30656 heartbeater.cc:503] Master 127.17.4.190:39167 was elected leader, sending a full tablet report...
I20260923 14:43:12.156354 30521 heartbeater.cc:503] Master 127.17.4.190:39167 was elected leader, sending a full tablet report...
W20260923 14:43:12.178653 30387 tablet.cc:2369] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:43:12.206915 30522 tablet.cc:2369] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:43:12.236153 30657 tablet.cc:2369] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:12.379925 30698 raft_consensus.cc:482] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:12.380182 30698 raft_consensus.cc:504] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.381536 30698 leader_election.cc:288] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ee1e6ab9eea4d76b7b82cec4db6a747 (127.17.4.131:42639), e2806e211dfb4e6aab5d8f42b45395cb (127.17.4.129:37707)
I20260923 14:43:12.387046 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.381825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37707 (local address 127.17.4.130:54991)
0923 14:43:12.382274 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:12.382287 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:12.382404 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:12.382772 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:12.382775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:12.382795 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:12.382914 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.382920 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.383953 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.383957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.385653 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.385665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.386590 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.386593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.386676 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.386698 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:43:12.386797 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 14:43:12.386877 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":152,"thread_start_us":112,"threads_started":1}
I20260923 14:43:12.387034 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.382005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:54991 (local address 127.17.4.129:37707)
0923 14:43:12.382155 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.382159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.382347 (+ 188us) server_negotiation.cc:407] Connection header received
0923 14:43:12.382600 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.382606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.382670 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.382753 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:12.383046 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.383827 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.385799 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.386455 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.386587 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.386644 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.386829 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.386907 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 14:43:12.387881 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.382178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:50803 (local address 127.17.4.131:42639)
0923 14:43:12.382346 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.382350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.382368 (+ 18us) server_negotiation.cc:407] Connection header received
0923 14:43:12.382462 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.382466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.382522 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.382615 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:12.382955 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.383816 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.386715 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.387306 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.387429 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.387477 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.387681 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.387777 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 14:43:12.387898 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.381820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:42639 (local address 127.17.4.130:50803)
0923 14:43:12.382203 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:12.382226 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:12.382350 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:12.382639 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:12.382642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:12.382660 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:12.382833 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.382840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.383953 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.383957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.385654 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:12.385665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.387434 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.387438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:12.387548 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.387574 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 14:43:12.387660 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:43:12.387730 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":144,"thread_start_us":124,"threads_started":1}
I20260923 14:43:12.388038 30339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e84738920f98431c9daec96e36d0080b" candidate_uuid: "8fa9718537864731b0088d7b716c1bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" is_pre_election: true
I20260923 14:43:12.388381 30339 raft_consensus.cc:2454] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa9718537864731b0088d7b716c1bb8 in term 0.
I20260923 14:43:12.388887 30409 leader_election.cc:302] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa9718537864731b0088d7b716c1bb8, e2806e211dfb4e6aab5d8f42b45395cb; no voters:
I20260923 14:43:12.389192 30698 raft_consensus.cc:2781] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:43:12.389222 30609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e84738920f98431c9daec96e36d0080b" candidate_uuid: "8fa9718537864731b0088d7b716c1bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" is_pre_election: true
I20260923 14:43:12.389303 30698 raft_consensus.cc:482] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:43:12.389354 30698 raft_consensus.cc:3037] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:12.389508 30609 raft_consensus.cc:2454] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa9718537864731b0088d7b716c1bb8 in term 0.
I20260923 14:43:12.390569 30698 raft_consensus.cc:504] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.390965 30698 leader_election.cc:288] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 2ee1e6ab9eea4d76b7b82cec4db6a747 (127.17.4.131:42639), e2806e211dfb4e6aab5d8f42b45395cb (127.17.4.129:37707)
I20260923 14:43:12.391235 30609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e84738920f98431c9daec96e36d0080b" candidate_uuid: "8fa9718537864731b0088d7b716c1bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747"
I20260923 14:43:12.391378 30609 raft_consensus.cc:3037] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:12.391394 30339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e84738920f98431c9daec96e36d0080b" candidate_uuid: "8fa9718537864731b0088d7b716c1bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2806e211dfb4e6aab5d8f42b45395cb"
I20260923 14:43:12.391499 30339 raft_consensus.cc:3037] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:12.392735 30609 raft_consensus.cc:2454] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa9718537864731b0088d7b716c1bb8 in term 1.
I20260923 14:43:12.392735 30339 raft_consensus.cc:2454] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa9718537864731b0088d7b716c1bb8 in term 1.
I20260923 14:43:12.393013 30408 leader_election.cc:302] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ee1e6ab9eea4d76b7b82cec4db6a747, 8fa9718537864731b0088d7b716c1bb8; no voters:
I20260923 14:43:12.393245 30698 raft_consensus.cc:2781] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:12.393492 30698 raft_consensus.cc:686] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa9718537864731b0088d7b716c1bb8, State: Running, Role: LEADER
I20260923 14:43:12.393816 30698 consensus_queue.cc:237] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } }
I20260923 14:43:12.397138 30185 catalog_manager.cc:5495] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa9718537864731b0088d7b716c1bb8 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "8fa9718537864731b0088d7b716c1bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa9718537864731b0088d7b716c1bb8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 42185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 } health_report { overall_health: UNKNOWN } } }
I20260923 14:43:12.432094 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.428365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42728 (local address 127.17.4.130:42185)
0923 14:43:12.428504 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:12.428510 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:12.428523 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:43:12.428624 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:12.428627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:12.428696 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:12.428808 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:43:12.429072 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.429713 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.430613 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:12.430836 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:12.430943 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:12.431251 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:43:12.431680 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:43:12.431844 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:12.431881 (+ 37us) server_negotiation.cc:299] Negotiation successful
0923 14:43:12.431936 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:43:12.437922 30609 raft_consensus.cc:1261] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 1 FOLLOWER]: Refusing update from remote peer 8fa9718537864731b0088d7b716c1bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:12.437944 30339 raft_consensus.cc:1261] T e84738920f98431c9daec96e36d0080b P e2806e211dfb4e6aab5d8f42b45395cb [term 1 FOLLOWER]: Refusing update from remote peer 8fa9718537864731b0088d7b716c1bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:12.438812 30709 consensus_queue.cc:1035] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ee1e6ab9eea4d76b7b82cec4db6a747" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:12.438990 30698 consensus_queue.cc:1035] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2806e211dfb4e6aab5d8f42b45395cb" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:12.445143 30712 mvcc.cc:205] Tried to move back new op lower bound from 7332555130618576896 to 7332555130447323136. Current Snapshot: MvccSnapshot[applied={T|T < 7332555130618576896}]
I20260923 14:43:12.454109 30714 mvcc.cc:205] Tried to move back new op lower bound from 7332555130618576896 to 7332555130447323136. Current Snapshot: MvccSnapshot[applied={T|T < 7332555130618576896}]
I20260923 14:43:12.458365 30184 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:12.458554 30184 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:12.460991 30184 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85d87e0f230148f59968e1aeb61b72b5: Sending DeleteTablet for 3 replicas of tablet e84738920f98431c9daec96e36d0080b
I20260923 14:43:12.462023 30454 tablet_service.cc:1514] Processing DeleteTablet for tablet e84738920f98431c9daec96e36d0080b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:12 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:42718
I20260923 14:43:12.462565 30721 tablet_replica.cc:330] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: stopping tablet replica
I20260923 14:43:12.462638 30588 tablet_service.cc:1514] Processing DeleteTablet for tablet e84738920f98431c9daec96e36d0080b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:12 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:54070
I20260923 14:43:12.462965 30721 raft_consensus.cc:2229] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:43:12.463078 30319 tablet_service.cc:1514] Processing DeleteTablet for tablet e84738920f98431c9daec96e36d0080b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:12 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:37218
I20260923 14:43:12.463387 30721 raft_consensus.cc:2258] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:12.464268 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30223
I20260923 14:43:12.465579 30721 ts_tablet_manager.cc:1905] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:12.466280 30722 tablet_replica.cc:330] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: stopping tablet replica
I20260923 14:43:12.466581 30722 raft_consensus.cc:2229] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:43:12.466913 30722 raft_consensus.cc:2258] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:12.469094 30721 ts_tablet_manager.cc:1918] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:12.469245 30721 log.cc:1196] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/e84738920f98431c9daec96e36d0080b
I20260923 14:43:12.469705 30721 ts_tablet_manager.cc:1939] T e84738920f98431c9daec96e36d0080b P 8fa9718537864731b0088d7b716c1bb8: Deleting consensus metadata
I20260923 14:43:12.471128 30171 catalog_manager.cc:4841] TS 8fa9718537864731b0088d7b716c1bb8 (127.17.4.130:42185): tablet e84738920f98431c9daec96e36d0080b (table test-table [id=845380688f714243bf9bb89548cff8ad]) successfully deleted
W20260923 14:43:12.472540 30171 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:37707 (error 108)
I20260923 14:43:12.473436 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30390
I20260923 14:43:12.473618 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:12.473305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37707 (local address 127.0.0.1:37234)
0923 14:43:12.473453 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:12.473532 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260923 14:43:12.474146 30171 catalog_manager.cc:4584] TS e2806e211dfb4e6aab5d8f42b45395cb (127.17.4.129:37707): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e84738920f98431c9daec96e36d0080b: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37707: connect: Connection refused (error 111)
I20260923 14:43:12.476708 30722 ts_tablet_manager.cc:1905] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:12.478922 30722 ts_tablet_manager.cc:1918] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:12.479046 30722 log.cc:1196] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/e84738920f98431c9daec96e36d0080b
I20260923 14:43:12.479346 30722 ts_tablet_manager.cc:1939] T e84738920f98431c9daec96e36d0080b P 2ee1e6ab9eea4d76b7b82cec4db6a747: Deleting consensus metadata
I20260923 14:43:12.480546 30170 catalog_manager.cc:4841] TS 2ee1e6ab9eea4d76b7b82cec4db6a747 (127.17.4.131:42639): tablet e84738920f98431c9daec96e36d0080b (table test-table [id=845380688f714243bf9bb89548cff8ad]) successfully deleted
I20260923 14:43:12.481118 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30524
I20260923 14:43:12.486454 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30152
I20260923 14:43:12.495147 17426 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 14:43:12.840054 17426 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 14:43:12.840164 17426 mini_ranger.cc:66] Stopping Ranger...
I20260923 14:43:13.184979 17426 mini_ranger.cc:68] Stopped Ranger
2026-09-23 14:43:13.185 UTC [29219] LOG: received smart shutdown request
2026-09-23 14:43:13.188 UTC [29219] LOG: background worker "logical replication launcher" (PID 29228) exited with exit code 1
2026-09-23 14:43:13.188 UTC [29223] LOG: shutting down
2026-09-23 14:43:13.354 UTC [29219] LOG: database system is shut down
2026-09-23T14:43:13Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49308 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:43:13 dist-test-slave-54kg krb5kdc[30733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:43:13 dist-test-slave-54kg krb5kdc[30733](info): set up 2 sockets
Sep 23 14:43:13 dist-test-slave-54kg krb5kdc[30733](info): commencing operation
krb5kdc: starting...
W20260923 14:43:14.513306 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:43:14 dist-test-slave-54kg krb5kdc[30733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:43:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:43:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:43:14.631068 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39213
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39213,127.17.4.189:34341,127.17.4.188:35705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:14.742264 30746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:14.742535 30746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:14.742640 30746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:14.746551 30746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:14.746631 30746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:14.746672 30746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:14.746729 30746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:14.746769 30746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:14.751813 30746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39213,127.17.4.189:34341,127.17.4.188:35705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:39213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:14.752820 30746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:14.753790 30746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:14.761916 30754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:14.761912 30751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:14.761973 30746 server_base.cc:1034] running on GCE node
W20260923 14:43:14.761912 30752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:14.762656 30746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:14.763661 30746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:14.764822 30746 hybrid_clock.cc:648] HybridClock initialized: now 1790174594764802 us; error 37 us; skew 500 ppm
Sep 23 14:43:14 dist-test-slave-54kg krb5kdc[30733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:14.767504 30746 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:14.768384 30746 webserver.cc:460] Webserver started at http://127.17.4.190:33055/ using document root <none> and password file <none>
I20260923 14:43:14.768918 30746 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:14.769008 30746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:14.769235 30746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:14.771147 30746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb"
format_stamp: "Formatted at 2026-09-23 14:43:14 on dist-test-slave-54kg"
server_key: "33e91bc686f91b7abe75004e0d77edb0"
server_key_iv: "44cd19d467d67cb04e0ce04cd60254ad"
server_key_version: "encryptionkey@0"
I20260923 14:43:14.771694 30746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb"
format_stamp: "Formatted at 2026-09-23 14:43:14 on dist-test-slave-54kg"
server_key: "33e91bc686f91b7abe75004e0d77edb0"
server_key_iv: "44cd19d467d67cb04e0ce04cd60254ad"
server_key_version: "encryptionkey@0"
I20260923 14:43:14.775168 30746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:43:14.777683 30761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:14.778828 30746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:14.778967 30746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb"
format_stamp: "Formatted at 2026-09-23 14:43:14 on dist-test-slave-54kg"
server_key: "33e91bc686f91b7abe75004e0d77edb0"
server_key_iv: "44cd19d467d67cb04e0ce04cd60254ad"
server_key_version: "encryptionkey@0"
I20260923 14:43:14.779079 30746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:14.804664 30746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:14.807548 30746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:14.807753 30746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:14.814735 30746 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:39213
I20260923 14:43:14.814754 30814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:39213 every 8 connection(s)
I20260923 14:43:14.815652 30746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:14.817049 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30746
I20260923 14:43:14.817183 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:43:14.817466 17426 external_mini_cluster.cc:1428] Setting key 19c331ecacd33150945f2a64275dc79a
I20260923 14:43:14.818580 30815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:14.822279 30815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.4.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.189@KRBTEST.COM" created.
Sep 23 14:43:14 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:14.838379 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.824667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39213 (local address 127.0.0.1:34138)
0923 14:43:14.825240 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.825277 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:14.826148 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:14.826809 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:14.826814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:14.827231 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:14.827602 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:14.827619 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:14.828779 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:14.828783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:14.830095 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:14.830110 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:14.831102 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:14.831106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:14.831201 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:14.831850 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:14.831877 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:14.833336 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:14.835603 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:14.835612 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:14.835619 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:14.835905 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:14.836242 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:14.836244 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:14.836246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:14.836363 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:14.836965 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:14.836970 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:14.837092 (+ 122us) client_negotiation.cc:769] Sending connection context
0923 14:43:14.837274 (+ 182us) client_negotiation.cc:240] Negotiation successful
0923 14:43:14.837620 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":69,"spinlock_wait_cycles":20736,"thread_start_us":156,"threads_started":1}
I20260923 14:43:14.838383 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.824666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34138 (local address 127.17.4.190:39213)
0923 14:43:14.825138 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:14.825158 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:14.825388 (+ 230us) server_negotiation.cc:407] Connection header received
0923 14:43:14.826452 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:14.826457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:14.826628 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:14.826821 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:14.827774 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:14.828651 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:14.830263 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:14.830938 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:14.831132 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:14.833497 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:14.833508 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:14.833524 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:14.833553 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:14.835498 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:14.836018 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:14.836028 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:14.836032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:14.836154 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:14.836437 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:14.836439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:14.836440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:14.836862 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:14.836964 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:14.837330 (+ 366us) server_negotiation.cc:299] Negotiation successful
0923 14:43:14.837526 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":131,"threads_started":1}
I20260923 14:43:14.840840 30815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:43:14.841609 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.841364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54348)
0923 14:43:14.841485 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.841552 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 14:43:14.841792 30765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
I20260923 14:43:14.842653 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.842466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54350)
0923 14:43:14.842565 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.842605 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 14:43:14.842801 30815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:34341: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab.
Entry for principal kudu/127.17.4.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab.
I20260923 14:43:14.844501 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:34341
--webserver_interface=127.17.4.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab
--principal=kudu/127.17.4.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39213,127.17.4.189:34341,127.17.4.188:35705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:14.892105 30815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } attempt: 1
I20260923 14:43:14.893080 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.892732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54352)
0923 14:43:14.892909 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.892986 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 14:43:14.893934 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.893701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54366)
0923 14:43:14.893814 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.893869 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 14:43:14.894083 30815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:34341: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
W20260923 14:43:14.953694 30822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:14.953956 30822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:14.954025 30822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:14.958014 30822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:14.958104 30822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:14.958144 30822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:14.958209 30822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:14.958247 30822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:14.962333 30815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } attempt: 2
I20260923 14:43:14.963142 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.962828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54368)
0923 14:43:14.962986 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.963055 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 14:43:14.963603 30822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39213,127.17.4.189:34341,127.17.4.188:35705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab
--principal=kudu/127.17.4.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:34341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.4.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:14.963902 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:14.963652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54382)
0923 14:43:14.963788 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:14.963841 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 14:43:14.964033 30815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:34341: Network error: Client connection negotiation failed: client connection to 127.17.4.189:34341: connect: Connection refused (error 111)
I20260923 14:43:14.964700 30822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:14.965651 30822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:14.973886 30830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:14.973897 30828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:14.973906 30827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:14.974257 30822 server_base.cc:1034] running on GCE node
I20260923 14:43:14.974797 30822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:14.975867 30822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:14.977058 30822 hybrid_clock.cc:648] HybridClock initialized: now 1790174594977030 us; error 46 us; skew 500 ppm
Sep 23 14:43:14 dist-test-slave-54kg krb5kdc[30733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:14.979928 30822 init.cc:377] Logged in from keytab as kudu/127.17.4.189@KRBTEST.COM (short username kudu)
I20260923 14:43:14.980764 30822 webserver.cc:460] Webserver started at http://127.17.4.189:36959/ using document root <none> and password file <none>
I20260923 14:43:14.981248 30822 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:14.981307 30822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:14.981462 30822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:14.983392 30822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data/instance:
uuid: "eee6c4f61d0448e796e8cb2654945339"
format_stamp: "Formatted at 2026-09-23 14:43:14 on dist-test-slave-54kg"
server_key: "6a7580361b216a774a00f36c3a3bc80f"
server_key_iv: "c46b7340b439a3238c4898426468150e"
server_key_version: "encryptionkey@0"
I20260923 14:43:14.983982 30822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal/instance:
uuid: "eee6c4f61d0448e796e8cb2654945339"
format_stamp: "Formatted at 2026-09-23 14:43:14 on dist-test-slave-54kg"
server_key: "6a7580361b216a774a00f36c3a3bc80f"
server_key_iv: "c46b7340b439a3238c4898426468150e"
server_key_version: "encryptionkey@0"
I20260923 14:43:14.987591 30822 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:43:14.989856 30837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:14.990945 30822 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:14.991063 30822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal
uuid: "eee6c4f61d0448e796e8cb2654945339"
format_stamp: "Formatted at 2026-09-23 14:43:14 on dist-test-slave-54kg"
server_key: "6a7580361b216a774a00f36c3a3bc80f"
server_key_iv: "c46b7340b439a3238c4898426468150e"
server_key_version: "encryptionkey@0"
I20260923 14:43:14.991158 30822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:15.002563 30822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:15.005721 30822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:15.005901 30822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:15.012976 30822 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.189:34341
I20260923 14:43:15.013002 30889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.189:34341 every 8 connection(s)
I20260923 14:43:15.013907 30822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
I20260923 14:43:15.016593 30890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:15.020176 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30822
I20260923 14:43:15.020308 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-1/wal/instance
I20260923 14:43:15.020612 17426 external_mini_cluster.cc:1428] Setting key 405faa1c310b405d602ad9461011e225
I20260923 14:43:15.021085 30890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.4.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.188@KRBTEST.COM" created.
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:15.037662 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.023247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34142 (local address 127.17.4.190:39213)
0923 14:43:15.023425 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.023431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.024173 (+ 742us) server_negotiation.cc:407] Connection header received
0923 14:43:15.025242 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.025247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.025320 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.025432 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.026533 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.027593 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.028783 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.029019 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.029136 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.032670 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.032673 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.032675 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.032701 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.035485 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.036071 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.036074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.036075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.036151 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.036499 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.036502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.036504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.036753 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.036850 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.037362 (+ 512us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.037486 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 14:43:15.038435 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.023538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39213 (local address 127.0.0.1:34142)
0923 14:43:15.024011 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.024061 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.024972 (+ 911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.025581 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.025588 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.025910 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.026372 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.026384 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.027740 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.027743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.028649 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.028659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.029175 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.029180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.029355 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.029990 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.030006 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.032489 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.035600 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.035605 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.035618 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.035949 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.036251 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.036254 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.036257 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.036396 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.036850 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.036859 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.037106 (+ 247us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.037293 (+ 187us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.037610 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":145,"threads_started":1}
I20260923 14:43:15.039875 30890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab.
Entry for principal kudu/127.17.4.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab.
I20260923 14:43:15.048698 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:35705
--webserver_interface=127.17.4.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab
--principal=kudu/127.17.4.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:39213,127.17.4.189:34341,127.17.4.188:35705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:15.049517 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.040379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54384)
0923 14:43:15.040494 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.040512 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.040583 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.041245 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.041248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.041375 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.041510 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.041515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.042554 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.042558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.043289 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.043299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.044035 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.044055 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.044178 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.044599 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.044615 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.045952 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.047986 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.047989 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.047991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.048187 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.048531 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.048533 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.048534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.048606 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.049126 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.049128 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.049203 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.049298 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.049395 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260923 14:43:15.049822 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.040567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54384 (local address 127.17.4.189:34341)
0923 14:43:15.040904 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.040915 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.040942 (+ 27us) server_negotiation.cc:407] Connection header received
0923 14:43:15.040974 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.040978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.041117 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.041222 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.041619 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.042410 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.043391 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.043899 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.043992 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.046072 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.046081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.046091 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.046110 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.047881 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.048325 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.048334 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.048337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.048432 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.048697 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.048701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.048703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.049029 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.049168 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.049401 (+ 233us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.049570 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":175,"threads_started":1}
I20260923 14:43:15.051484 30890 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:43:15.052191 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.051968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33536)
0923 14:43:15.052073 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.052139 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 14:43:15.052434 30839 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
I20260923 14:43:15.053287 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.053081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33544)
0923 14:43:15.053201 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.053242 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 14:43:15.053445 30890 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35705: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
I20260923 14:43:15.055181 30815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } attempt: 3
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:43:15.063920 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.055638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54396 (local address 127.17.4.189:34341)
0923 14:43:15.055740 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.055751 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.055825 (+ 74us) server_negotiation.cc:407] Connection header received
0923 14:43:15.055978 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.055980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.056014 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.056075 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.056643 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.057134 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.058400 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.058624 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.058702 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.060894 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.060897 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.060900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.060930 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.062280 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.062703 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.062706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.062708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.062783 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.063052 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.063056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.063058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.063289 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.063396 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.063651 (+ 255us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.063776 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:43:15.063915 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.055554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54396)
0923 14:43:15.055718 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.055736 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.055884 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.056128 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.056132 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.056356 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.056508 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.056518 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.057246 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.057251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.058262 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.058276 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.058739 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.058744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.058879 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.059377 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.059394 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.060763 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.062404 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.062408 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.062410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.062598 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.062874 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.062878 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.062880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.062962 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.063397 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.063400 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.063499 (+ 99us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.063603 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.063730 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260923 14:43:15.064925 30815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:43:15.065646 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.065358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33546)
0923 14:43:15.065491 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.065556 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 14:43:15.066363 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.066100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33552)
0923 14:43:15.066245 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.066303 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260923 14:43:15.066489 30815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35705: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
I20260923 14:43:15.097643 30815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } attempt: 1
I20260923 14:43:15.098493 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.098163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33560)
0923 14:43:15.098335 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.098405 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260923 14:43:15.099205 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.098981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33566)
0923 14:43:15.099093 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.099144 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 14:43:15.099339 30815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35705: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
I20260923 14:43:15.102656 30890 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } attempt: 1
I20260923 14:43:15.103355 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.103048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33572)
0923 14:43:15.103185 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.103247 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 14:43:15.104126 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.103897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33584)
0923 14:43:15.104005 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.104063 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 14:43:15.104277 30890 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35705: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
W20260923 14:43:15.163388 30896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:15.163623 30896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:15.163700 30896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:15.167613 30896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:15.167672 30896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:15.167691 30896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:15.167739 30896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:15.167793 30896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:15.172446 30890 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } attempt: 2
I20260923 14:43:15.173164 30896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:39213,127.17.4.189:34341,127.17.4.188:35705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab
--principal=kudu/127.17.4.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:35705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.4.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:15.173249 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.172927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33586)
0923 14:43:15.173089 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.173158 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260923 14:43:15.174433 30896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:15.174475 30815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } attempt: 2
I20260923 14:43:15.175134 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.174902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33610)
0923 14:43:15.175022 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.175073 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 14:43:15.175323 30890 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35705: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
I20260923 14:43:15.175421 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.174905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33594)
0923 14:43:15.175096 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.175153 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260923 14:43:15.175700 30896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:43:15.176038 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.175864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33616)
0923 14:43:15.175950 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.175991 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260923 14:43:15.176184 30815 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35705: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35705: connect: Connection refused (error 111)
W20260923 14:43:15.183723 30904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:15.183723 30906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:15.183809 30903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:15.184218 30896 server_base.cc:1034] running on GCE node
I20260923 14:43:15.184708 30896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:15.185673 30896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:15.186838 30896 hybrid_clock.cc:648] HybridClock initialized: now 1790174595186802 us; error 44 us; skew 500 ppm
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174595, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:15.189455 30896 init.cc:377] Logged in from keytab as kudu/127.17.4.188@KRBTEST.COM (short username kudu)
I20260923 14:43:15.190301 30896 webserver.cc:460] Webserver started at http://127.17.4.188:46153/ using document root <none> and password file <none>
I20260923 14:43:15.190829 30896 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:15.190919 30896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:15.191140 30896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:15.193142 30896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data/instance:
uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8"
format_stamp: "Formatted at 2026-09-23 14:43:15 on dist-test-slave-54kg"
server_key: "65c2fc3a8b4a4d906fc045059fbde584"
server_key_iv: "392c7da960260e10cfbb1ba078057151"
server_key_version: "encryptionkey@0"
I20260923 14:43:15.193691 30896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal/instance:
uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8"
format_stamp: "Formatted at 2026-09-23 14:43:15 on dist-test-slave-54kg"
server_key: "65c2fc3a8b4a4d906fc045059fbde584"
server_key_iv: "392c7da960260e10cfbb1ba078057151"
server_key_version: "encryptionkey@0"
I20260923 14:43:15.197228 30896 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260923 14:43:15.199433 30913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:15.200642 30896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:43:15.200775 30896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal
uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8"
format_stamp: "Formatted at 2026-09-23 14:43:15 on dist-test-slave-54kg"
server_key: "65c2fc3a8b4a4d906fc045059fbde584"
server_key_iv: "392c7da960260e10cfbb1ba078057151"
server_key_version: "encryptionkey@0"
I20260923 14:43:15.200879 30896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:15.245352 30896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:15.248194 30896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:15.248428 30896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:15.255446 30896 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.188:35705
I20260923 14:43:15.255519 30965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.188:35705 every 8 connection(s)
I20260923 14:43:15.256458 30896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
I20260923 14:43:15.259178 30966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:15.262938 30966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:43:15.265760 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 30896
I20260923 14:43:15.265894 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790174436877568-17426-0/minicluster-data/master-2/wal/instance
I20260923 14:43:15.266155 17426 external_mini_cluster.cc:1428] Setting key 4fe8d610a16067ba45ea6f2fb597cfae
I20260923 14:43:15.266484 30890 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } attempt: 3
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174595, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:43:15.275357 30815 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } attempt: 3
I20260923 14:43:15.278174 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.264820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34152 (local address 127.17.4.190:39213)
0923 14:43:15.264988 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.264993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.265754 (+ 761us) server_negotiation.cc:407] Connection header received
0923 14:43:15.266960 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.266964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.267020 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.267079 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.268636 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.269149 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.270562 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.270903 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.271000 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.273594 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.273598 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.273600 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.273629 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.275382 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.276312 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.276319 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.276324 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.276418 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.276902 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.276908 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.276923 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.277185 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.277298 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.277916 (+ 618us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.278055 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 14:43:15.279805 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.265162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:39213 (local address 127.0.0.1:34152)
0923 14:43:15.265605 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.265647 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.266707 (+ 1060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.267451 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.267459 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.267935 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.268484 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.268498 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.269272 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.269276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.270411 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.270422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.271047 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.271051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.271302 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.271979 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.271994 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.273445 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.275511 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.275518 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.275526 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.276192 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.276554 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.276559 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.276564 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.276770 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.277355 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.277364 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.277587 (+ 223us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.278410 (+ 823us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.278683 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":246,"thread_start_us":104,"threads_started":1}
I20260923 14:43:15.279932 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.266931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33640)
0923 14:43:15.267108 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.267121 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.267208 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.267935 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.267939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.268125 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.268264 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.268274 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.270031 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.270035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.270728 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.270738 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.271528 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.271535 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.271633 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.272098 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.272112 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.273848 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.276368 (+ 2520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.276373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.276378 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.276641 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.278791 (+ 2150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.278794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.278796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.278900 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.279389 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.279392 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.279489 (+ 97us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.279574 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.279730 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260923 14:43:15.280654 30971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.267399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33640 (local address 127.17.4.188:35705)
0923 14:43:15.267649 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.267656 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.267666 (+ 10us) server_negotiation.cc:407] Connection header received
0923 14:43:15.267702 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.267703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.267766 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.268390 (+ 624us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.268530 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.269900 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.270848 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.271377 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.271842 (+ 465us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.273967 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.273973 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.273991 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.274010 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.276232 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.277814 (+ 1582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.277820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.277822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.277932 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.279006 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.279009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.279011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.279265 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.280208 (+ 943us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.280308 (+ 100us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.280447 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":266,"server-negotiator.queue_time_us":200,"thread_start_us":102,"threads_started":1}
I20260923 14:43:15.281199 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.266792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33630 (local address 127.17.4.188:35705)
0923 14:43:15.267256 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.267268 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.267308 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:43:15.267426 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.267431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.267622 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.267844 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.268694 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.269900 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.270854 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.271369 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.271486 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.275850 (+ 4364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.275854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.275856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.275882 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.278641 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.279125 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.279129 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.279131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.279211 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.279498 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.279501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.279502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.280012 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.280197 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.280921 (+ 724us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.281028 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":133,"server-negotiator.queue_time_us":377,"spinlock_wait_cycles":2816,"thread_start_us":154,"threads_started":1}
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:43:15.281771 30966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:43:15.285666 30890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: Bootstrap starting.
I20260923 14:43:15.285992 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.275752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33650)
0923 14:43:15.275973 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.275987 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.276064 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.276512 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.276515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.276698 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.276807 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.276812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.277931 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.277935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.278819 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.278830 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.279402 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.279406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.279485 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.280412 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.280428 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.281850 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.284401 (+ 2551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.284407 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.284412 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.284673 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.285016 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.285019 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.285020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.285108 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.285552 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.285555 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.285639 (+ 84us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.285712 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.285829 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260923 14:43:15.286636 30972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.275930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33650 (local address 127.17.4.188:35705)
0923 14:43:15.276230 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.276240 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.276252 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:43:15.276296 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.276301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.276346 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.276504 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.276946 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.277806 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.278961 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.279280 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.279680 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.281995 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.281998 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.282000 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.282042 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.284292 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.284805 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.284810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.284815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.284906 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.285227 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.285230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.285232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.285439 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.286262 (+ 823us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.286357 (+ 95us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.286481 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":110,"threads_started":1}
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174595, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:43:15.288759 30890 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:15.289728 30890 log.cc:824] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:15.289942 30815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: Bootstrap starting.
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:15.291723 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.282673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54400 (local address 127.17.4.189:34341)
0923 14:43:15.282780 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.282784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.282800 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:43:15.282933 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.282936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.282979 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.283061 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.283578 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.284303 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.285301 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.285599 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.285670 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.288145 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.288149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.288151 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.288175 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.289756 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.290306 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.290310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.290312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.290389 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.290765 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.290771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.290776 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.291024 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.291096 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.291460 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.291581 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:43:15.292279 30890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: No bootstrap required, opened a new log
I20260923 14:43:15.292487 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.282232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:34341 (local address 127.0.0.1:54400)
0923 14:43:15.282745 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.282760 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.282842 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.283174 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.283177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.283344 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.283443 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.283450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.284441 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.284444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.285152 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.285162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.285848 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.285851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.285945 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.286455 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.286468 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.288003 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.289905 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.289907 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.289909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.290200 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.290557 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.290560 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.290562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.290652 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.291168 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.291171 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.291271 (+ 100us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.292135 (+ 864us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.292289 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432}
I20260923 14:43:15.292966 30815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:15.293408 30966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:43:15.294066 30815 log.cc:824] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:15.294931 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.283591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34162 (local address 127.17.4.190:39213)
0923 14:43:15.283689 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.283693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.284005 (+ 312us) server_negotiation.cc:407] Connection header received
0923 14:43:15.284232 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.284239 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.284284 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.284336 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.285226 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.285906 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.287220 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.287524 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.287614 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.291006 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.291010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.291012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.291037 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.292760 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.293340 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.293343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.293345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.293438 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.293752 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.293756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.293757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.293988 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.294128 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.294641 (+ 513us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.294764 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260923 14:43:15.296968 30815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: No bootstrap required, opened a new log
I20260923 14:43:15.297327 30890 raft_consensus.cc:348] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.297554 30890 raft_consensus.cc:374] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:15.297617 30890 raft_consensus.cc:729] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eee6c4f61d0448e796e8cb2654945339, State: Initialized, Role: FOLLOWER
I20260923 14:43:15.298148 30890 consensus_queue.cc:260] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174595, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:43:15.299530 30890 sys_catalog.cc:564] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:15.301998 30815 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.302258 30815 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:15.302309 30815 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5c10af93aa4950b6a4d6a4aaa2d1fb, State: Initialized, Role: FOLLOWER
I20260923 14:43:15.302881 30975 sys_catalog.cc:455] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.303004 30975 sys_catalog.cc:458] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: This master's current role is: FOLLOWER
Sep 23 14:43:15 dist-test-slave-54kg krb5kdc[30733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:43:15.303424 30815 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.303678 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.293877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35705 (local address 127.0.0.1:33656)
0923 14:43:15.294126 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:15.294139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:15.294273 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:15.294579 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:15.294585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:15.294745 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:15.294826 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.294832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.296098 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.296101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.296876 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:15.296886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.297753 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.297757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:15.297837 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.298272 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:15.298385 (+ 113us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:15.299881 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:15.301947 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.301950 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.301952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.302224 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.302605 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:15.302607 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:15.302609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:15.302691 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:15.303212 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:15.303217 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:15.303307 (+ 90us) client_negotiation.cc:769] Sending connection context
0923 14:43:15.303408 (+ 101us) client_negotiation.cc:240] Negotiation successful
0923 14:43:15.303530 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190}
I20260923 14:43:15.304842 30815 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:15.305253 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.294036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.17.4.188:35705)
0923 14:43:15.294229 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.294233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.294247 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:43:15.294389 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.294393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.294429 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.294485 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.294941 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.295988 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.297002 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.297387 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.297481 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.300021 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.300025 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.300027 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.300048 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.301846 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.302424 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.302427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.302428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.302511 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.302788 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.302790 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.302792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.302993 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.303086 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.304677 (+ 1591us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.304797 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260923 14:43:15.303381 30822 master_runner.cc:186] Error getting master registration for 127.17.4.190:39213: OK, instance_id { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" instance_seqno: 1790174594812768 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 14:43:15.307617 30822 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 14:43:15.308219 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.296239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54416 (local address 127.17.4.189:34341)
0923 14:43:15.296354 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.296360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.296644 (+ 284us) server_negotiation.cc:407] Connection header received
0923 14:43:15.296683 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.296686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.296727 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.296795 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.297649 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.298355 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.299427 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.299756 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.299889 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.304089 (+ 4200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.304093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.304095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.304121 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.306061 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.306593 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.306599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.306602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.306699 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.307038 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.307041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.307043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.307257 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.307424 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.307960 (+ 536us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.308084 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:43:15.308265 30966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: Bootstrap starting.
I20260923 14:43:15.308717 30987 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.308828 30987 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: This master's current role is: FOLLOWER
W20260923 14:43:15.309335 30767 tablet.cc:2369] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:15.311391 30966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:15.311843 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260923 14:43:15.312160 30998 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:43:15.312237 30998 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:43:15.312274 30966 log.cc:824] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:15.315341 30966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: No bootstrap required, opened a new log
W20260923 14:43:15.320364 30986 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260923 14:43:15.316646 30746 master_runner.cc:186] Error getting master registration for 127.17.4.188:35705: OK, instance_id { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" instance_seqno: 1790174595253467 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260923 14:43:15.320464 30986 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:43:15.320650 30746 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 14:43:15.324888 30966 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.325212 30966 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:15.325273 30966 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ee7b77c3734ff2bdd2800d49e65cc8, State: Initialized, Role: FOLLOWER
I20260923 14:43:15.325973 30966 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.327421 30966 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:15.327752 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.314494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33666 (local address 127.17.4.188:35705)
0923 14:43:15.314612 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.314617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.316624 (+ 2007us) server_negotiation.cc:407] Connection header received
0923 14:43:15.316838 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.316841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.316888 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.316936 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.319298 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.320109 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.321149 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.321469 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.321570 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.323444 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.323450 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.323456 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.323486 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.325414 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.326097 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.326102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.326105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.326205 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.326621 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.326627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.326632 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.326861 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.326968 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.327386 (+ 418us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.327536 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260923 14:43:15.330641 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.315243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.17.4.190:39213)
0923 14:43:15.315359 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.315363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.318100 (+ 2737us) server_negotiation.cc:407] Connection header received
0923 14:43:15.318260 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.318263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.318311 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.318361 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.321199 (+ 2838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.321908 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.323866 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.324257 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.324377 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.326756 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.326760 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.326762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.326802 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.328795 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.329265 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.329271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.329276 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.329378 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.329672 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.329675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.329677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.329882 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.329998 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.330355 (+ 357us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.330481 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260923 14:43:15.333480 31020 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:43:15.333560 31020 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:43:15.333848 31009 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.333976 31009 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:43:15.337013 30896 master_runner.cc:263] No leader master found from master f3ee7b77c3734ff2bdd2800d49e65cc8
I20260923 14:43:15.337083 30896 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 14:43:15.341533 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:15.316257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54428 (local address 127.17.4.189:34341)
0923 14:43:15.316388 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:15.316392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:15.323301 (+ 6909us) server_negotiation.cc:407] Connection header received
0923 14:43:15.323490 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:15.323493 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:15.323546 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:15.323600 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:15.329312 (+ 5712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.330074 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.334860 (+ 4786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:15.335216 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:15.335313 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:15.337846 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:15.337850 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:15.337853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:15.337881 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:15.339586 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.340159 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.340163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.340165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.340264 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:15.340578 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:15.340582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:15.340584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:15.340815 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:15.340959 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:15.341245 (+ 286us) server_negotiation.cc:299] Negotiation successful
0923 14:43:15.341367 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260923 14:43:15.499884 30919 tablet.cc:2369] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:43:15.507300 30843 tablet.cc:2369] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:15.538270 30987 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:15.538468 30987 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.539438 30987 leader_election.cc:288] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eee6c4f61d0448e796e8cb2654945339 (127.17.4.189:34341), f3ee7b77c3734ff2bdd2800d49e65cc8 (127.17.4.188:35705)
I20260923 14:43:15.539958 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" is_pre_election: true
I20260923 14:43:15.539954 30864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eee6c4f61d0448e796e8cb2654945339" is_pre_election: true
I20260923 14:43:15.540259 30864 raft_consensus.cc:2454] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5c10af93aa4950b6a4d6a4aaa2d1fb in term 0.
I20260923 14:43:15.540306 30940 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5c10af93aa4950b6a4d6a4aaa2d1fb in term 0.
I20260923 14:43:15.540676 30765 leader_election.cc:302] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5c10af93aa4950b6a4d6a4aaa2d1fb, eee6c4f61d0448e796e8cb2654945339; no voters:
I20260923 14:43:15.540971 30987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:43:15.541061 30987 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:43:15.541106 30987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:15.542321 30987 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.542703 30987 leader_election.cc:288] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [CANDIDATE]: Term 1 election: Requested vote from peers eee6c4f61d0448e796e8cb2654945339 (127.17.4.189:34341), f3ee7b77c3734ff2bdd2800d49e65cc8 (127.17.4.188:35705)
I20260923 14:43:15.543004 30864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eee6c4f61d0448e796e8cb2654945339"
I20260923 14:43:15.543081 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8"
I20260923 14:43:15.543138 30864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:15.543226 30940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:15.544286 30864 raft_consensus.cc:2454] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5c10af93aa4950b6a4d6a4aaa2d1fb in term 1.
I20260923 14:43:15.544348 30940 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5c10af93aa4950b6a4d6a4aaa2d1fb in term 1.
I20260923 14:43:15.544589 30765 leader_election.cc:302] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5c10af93aa4950b6a4d6a4aaa2d1fb, eee6c4f61d0448e796e8cb2654945339; no voters:
I20260923 14:43:15.544754 30987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:15.545023 30987 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [term 1 LEADER]: Becoming Leader. State: Replica: ad5c10af93aa4950b6a4d6a4aaa2d1fb, State: Running, Role: LEADER
I20260923 14:43:15.545341 30987 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } }
I20260923 14:43:15.547053 31022 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad5c10af93aa4950b6a4d6a4aaa2d1fb. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.547173 31022 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:15.547546 31024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:15.548429 31024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:15.552798 30940 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [term 1 FOLLOWER]: Refusing update from remote peer ad5c10af93aa4950b6a4d6a4aaa2d1fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:15.552827 30864 raft_consensus.cc:1261] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [term 1 FOLLOWER]: Refusing update from remote peer ad5c10af93aa4950b6a4d6a4aaa2d1fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:15.553369 31022 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:15.553503 30987 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:15.557078 30975 sys_catalog.cc:455] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad5c10af93aa4950b6a4d6a4aaa2d1fb. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.557188 30975 sys_catalog.cc:458] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:43:15.557176 31009 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad5c10af93aa4950b6a4d6a4aaa2d1fb. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.557281 31009 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:43:15.559818 31022 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.559943 31022 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:15.560460 31022 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.560570 31022 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:15.560966 30975 sys_catalog.cc:455] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.561076 30975 sys_catalog.cc:458] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:43:15.561203 31027 mvcc.cc:205] Tried to move back new op lower bound from 7332555143377870848 to 7332555143355785216. Current Snapshot: MvccSnapshot[applied={T|T < 7332555143377870848}]
I20260923 14:43:15.561509 31024 catalog_manager.cc:1347] Generated new cluster ID: a0ea6f6c59f84ba2bf97b0bafa230e39
I20260923 14:43:15.561573 31024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:15.561780 31009 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5c10af93aa4950b6a4d6a4aaa2d1fb" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 39213 } } peers { permanent_uuid: "eee6c4f61d0448e796e8cb2654945339" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 34341 } } peers { permanent_uuid: "f3ee7b77c3734ff2bdd2800d49e65cc8" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35705 } } }
I20260923 14:43:15.561887 31009 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:43:15.570979 31024 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:43:15.571983 31024 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:15.579589 31024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad5c10af93aa4950b6a4d6a4aaa2d1fb: Generated new TSK 0
I20260923 14:43:15.580338 31024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:43:16.321710 30986 catalog_manager.cc:1259] Loaded cluster ID: a0ea6f6c59f84ba2bf97b0bafa230e39
I20260923 14:43:16.321828 30986 catalog_manager.cc:1552] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: loading cluster ID for follower catalog manager: success
I20260923 14:43:16.323449 30986 catalog_manager.cc:1574] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: acquiring CA information for follower catalog manager: success
I20260923 14:43:16.324627 30986 catalog_manager.cc:1602] T 00000000000000000000000000000000 P eee6c4f61d0448e796e8cb2654945339: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 14:43:16.334633 31020 catalog_manager.cc:1259] Loaded cluster ID: a0ea6f6c59f84ba2bf97b0bafa230e39
I20260923 14:43:16.334734 31020 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: loading cluster ID for follower catalog manager: success
I20260923 14:43:16.336328 31020 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: acquiring CA information for follower catalog manager: success
I20260923 14:43:16.337443 31020 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f3ee7b77c3734ff2bdd2800d49e65cc8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 14:43:16.651576 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30746
I20260923 14:43:16.658046 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30822
I20260923 14:43:16.663887 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 30896
2026-09-23T14:43:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3192 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:43:16 dist-test-slave-54kg krb5kdc[31041](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:43:16 dist-test-slave-54kg krb5kdc[31041](info): set up 2 sockets
Sep 23 14:43:16 dist-test-slave-54kg krb5kdc[31041](info): commencing operation
krb5kdc: starting...
W20260923 14:43:17.736980 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:43:17 dist-test-slave-54kg krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:43:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:43:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:43:17.854830 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34027
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:34027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:17.961316 31054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:17.961608 31054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:17.961688 31054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:17.965579 31054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:17.965662 31054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:17.965700 31054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:17.965760 31054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:17.965799 31054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:17.970826 31054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:34027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:17.971848 31054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:17.972841 31054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:17.981163 31059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:17.981176 31062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:17.981295 31054 server_base.cc:1034] running on GCE node
W20260923 14:43:17.981176 31060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:17.981945 31054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:17.982983 31054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:17.984136 31054 hybrid_clock.cc:648] HybridClock initialized: now 1790174597984107 us; error 42 us; skew 500 ppm
Sep 23 14:43:17 dist-test-slave-54kg krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174597, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:17.986836 31054 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:17.987675 31054 webserver.cc:460] Webserver started at http://127.17.4.190:37459/ using document root <none> and password file <none>
I20260923 14:43:17.988242 31054 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:17.988310 31054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:17.988534 31054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:17.990588 31054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "ce62c795b83c4867a3362c6635683c22"
format_stamp: "Formatted at 2026-09-23 14:43:17 on dist-test-slave-54kg"
server_key: "602c81ceb68b9934451b2eb947defc34"
server_key_iv: "cf116481a44d4b215f246faa1be6b917"
server_key_version: "encryptionkey@0"
I20260923 14:43:17.991302 31054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "ce62c795b83c4867a3362c6635683c22"
format_stamp: "Formatted at 2026-09-23 14:43:17 on dist-test-slave-54kg"
server_key: "602c81ceb68b9934451b2eb947defc34"
server_key_iv: "cf116481a44d4b215f246faa1be6b917"
server_key_version: "encryptionkey@0"
I20260923 14:43:17.994938 31054 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:43:17.997277 31069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:17.998461 31054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:43:17.998605 31054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "ce62c795b83c4867a3362c6635683c22"
format_stamp: "Formatted at 2026-09-23 14:43:17 on dist-test-slave-54kg"
server_key: "602c81ceb68b9934451b2eb947defc34"
server_key_iv: "cf116481a44d4b215f246faa1be6b917"
server_key_version: "encryptionkey@0"
I20260923 14:43:17.998716 31054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:18.019299 31054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:18.022146 31054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:18.022356 31054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:18.029101 31054 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:34027
I20260923 14:43:18.029122 31121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:34027 every 8 connection(s)
I20260923 14:43:18.030041 31054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:18.030223 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31054
I20260923 14:43:18.030344 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:43:18.030686 17426 external_mini_cluster.cc:1428] Setting key 4a06abe49ca1b31e6f3104936df4d61e
I20260923 14:43:18.033380 31122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 14:43:18 dist-test-slave-54kg krb5kdc[31041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:18.039850 31122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22: Bootstrap starting.
I20260923 14:43:18.042297 31122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:18.043188 31122 log.cc:824] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:18.044917 31125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:18.032055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.17.4.190:34027)
0923 14:43:18.032529 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:18.032547 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:18.032588 (+ 41us) server_negotiation.cc:407] Connection header received
0923 14:43:18.033411 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:18.033435 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:18.033822 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:18.034152 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:18.034807 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:18.036277 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:18.037099 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:18.037756 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:18.037907 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:18.040506 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:18.040511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:18.040523 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:18.040548 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:18.042165 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:18.042645 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:18.042650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:18.042654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:18.042757 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:18.043062 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:18.043064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:18.043065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:18.043477 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:18.043684 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:18.043976 (+ 292us) server_negotiation.cc:299] Negotiation successful
0923 14:43:18.044244 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":170,"threads_started":1}
I20260923 14:43:18.045089 31122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22: No bootstrap required, opened a new log
I20260923 14:43:18.047886 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:43:18.048174 31122 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce62c795b83c4867a3362c6635683c22" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34027 } }
I20260923 14:43:18.048398 31122 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:18.048475 31122 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce62c795b83c4867a3362c6635683c22, State: Initialized, Role: FOLLOWER
I20260923 14:43:18.048934 31122 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce62c795b83c4867a3362c6635683c22" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34027 } }
I20260923 14:43:18.049084 31122 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:18.049175 31122 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:18.049278 31122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:18.050203 31122 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce62c795b83c4867a3362c6635683c22" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34027 } }
I20260923 14:43:18.050546 31122 leader_election.cc:302] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce62c795b83c4867a3362c6635683c22; no voters:
I20260923 14:43:18.050850 31122 leader_election.cc:288] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:43:18.050968 31127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:18.051223 31127 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [term 1 LEADER]: Becoming Leader. State: Replica: ce62c795b83c4867a3362c6635683c22, State: Running, Role: LEADER
I20260923 14:43:18.051667 31127 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce62c795b83c4867a3362c6635683c22" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34027 } }
I20260923 14:43:18.052057 31122 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:18.053252 31129 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce62c795b83c4867a3362c6635683c22. Latest consensus state: current_term: 1 leader_uuid: "ce62c795b83c4867a3362c6635683c22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce62c795b83c4867a3362c6635683c22" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34027 } } }
I20260923 14:43:18.053376 31129 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:18.053781 31136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:18.053738 31128 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce62c795b83c4867a3362c6635683c22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce62c795b83c4867a3362c6635683c22" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34027 } } }
I20260923 14:43:18.054417 31128 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:18.056411 31136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:18.061841 31136 catalog_manager.cc:1347] Generated new cluster ID: 7e627e0722764c8a81f7fefc946c2189
I20260923 14:43:18.061915 31136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:18.076046 31136 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:43:18.076918 31136 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:18.085325 31136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce62c795b83c4867a3362c6635683c22: Generated new TSK 0
I20260923 14:43:18.085980 31136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:43:18.103649 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31054
2026-09-23T14:43:18Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1437 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:43:18 dist-test-slave-54kg krb5kdc[31149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:43:18 dist-test-slave-54kg krb5kdc[31149](info): set up 2 sockets
Sep 23 14:43:18 dist-test-slave-54kg krb5kdc[31149](info): commencing operation
krb5kdc: starting...
W20260923 14:43:19.129235 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:43:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:43:19.247555 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44477
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:19.354038 31162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:19.354346 31162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:19.354418 31162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:19.358385 31162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:19.358479 31162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:19.358518 31162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:19.358579 31162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:19.358615 31162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:19.363716 31162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:19.364775 31162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:19.365792 31162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:19.374183 31171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:19.374223 31168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:19.374157 31162 server_base.cc:1034] running on GCE node
W20260923 14:43:19.374150 31169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:19.374939 31162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:19.376065 31162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:19.377246 31162 hybrid_clock.cc:648] HybridClock initialized: now 1790174599377218 us; error 42 us; skew 500 ppm
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:19.379949 31162 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:19.380841 31162 webserver.cc:460] Webserver started at http://127.17.4.190:39797/ using document root <none> and password file <none>
I20260923 14:43:19.381382 31162 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:19.381470 31162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:19.381702 31162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:19.383711 31162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "157803083f0d4f4795c1acc12ee1ae09"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "b6c36f36a2313cb4fe6d88a4f9d8667e"
server_key_iv: "6d759e29ff37802a4ae6063c0e52c45b"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.384346 31162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "157803083f0d4f4795c1acc12ee1ae09"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "b6c36f36a2313cb4fe6d88a4f9d8667e"
server_key_iv: "6d759e29ff37802a4ae6063c0e52c45b"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.387939 31162 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:43:19.390159 31178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.391259 31162 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:19.391393 31162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "157803083f0d4f4795c1acc12ee1ae09"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "b6c36f36a2313cb4fe6d88a4f9d8667e"
server_key_iv: "6d759e29ff37802a4ae6063c0e52c45b"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.391500 31162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:19.412922 31162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:19.415943 31162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:19.416095 31162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:19.423015 31162 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44477
I20260923 14:43:19.423352 31230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44477 every 8 connection(s)
I20260923 14:43:19.424127 31162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:19.426877 31231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:19.432507 31231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap starting.
I20260923 14:43:19.433568 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31162
I20260923 14:43:19.433714 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:43:19.434017 17426 external_mini_cluster.cc:1428] Setting key 9ce9451c881b169ed447a28ed3f24c54
I20260923 14:43:19.435473 31231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:19.436429 31231 log.cc:824] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:19.438277 31231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: No bootstrap required, opened a new log
I20260923 14:43:19.441891 31231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:19.442147 31231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:19.442219 31231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 157803083f0d4f4795c1acc12ee1ae09, State: Initialized, Role: FOLLOWER
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:19.442724 31231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:19.442896 31231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:19.442965 31231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:19.443122 31231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:19.444208 31231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:19.444577 31231 leader_election.cc:302] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 157803083f0d4f4795c1acc12ee1ae09; no voters:
I20260923 14:43:19.444885 31231 leader_election.cc:288] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:43:19.444990 31236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:19.445196 31236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 LEADER]: Becoming Leader. State: Replica: 157803083f0d4f4795c1acc12ee1ae09, State: Running, Role: LEADER
I20260923 14:43:19.445504 31236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:19.446269 31231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:19.447376 31237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "157803083f0d4f4795c1acc12ee1ae09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } } }
I20260923 14:43:19.447398 31238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 157803083f0d4f4795c1acc12ee1ae09. Latest consensus state: current_term: 1 leader_uuid: "157803083f0d4f4795c1acc12ee1ae09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } } }
I20260923 14:43:19.447494 31237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:19.447501 31238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:19.447914 31245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:19.449137 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:19.435129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46092 (local address 127.17.4.190:44477)
0923 14:43:19.435591 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:19.435619 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:19.435663 (+ 44us) server_negotiation.cc:407] Connection header received
0923 14:43:19.436599 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:19.436623 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:19.436958 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:19.437295 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:19.438079 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.439115 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.439997 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.440474 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.440651 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:19.443446 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:19.443451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:19.443463 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:19.443488 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:19.445399 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:19.445893 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:19.445899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:19.445905 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:19.446043 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:19.446348 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:19.446351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:19.446352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:19.446893 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:19.447073 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:19.447951 (+ 878us) server_negotiation.cc:299] Negotiation successful
0923 14:43:19.448242 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":131,"threads_started":1}
I20260923 14:43:19.450757 31245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:19.459297 31245 catalog_manager.cc:1347] Generated new cluster ID: f2e84247c0824a079188073ac3ebb201
I20260923 14:43:19.459425 31245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:19.474805 31245 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:43:19.476087 31245 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:19.481783 31245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Generated new TSK 0
I20260923 14:43:19.482484 31245 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:43:19.514961 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44477
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:19.625779 31257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:19.626039 31257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:19.626138 31257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:19.630452 31257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:19.630509 31257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:19.630620 31257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:43:19.635915 31257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:19.636976 31257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:19.637984 31257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:19.649963 31265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:19.650015 31257 server_base.cc:1034] running on GCE node
W20260923 14:43:19.650020 31262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:19.650146 31263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:19.650626 31257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:19.651214 31257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:19.652412 31257 hybrid_clock.cc:648] HybridClock initialized: now 1790174599652397 us; error 26 us; skew 500 ppm
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:19.655189 31257 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:43:19.656075 31257 webserver.cc:460] Webserver started at http://127.17.4.129:40081/ using document root <none> and password file <none>
I20260923 14:43:19.656643 31257 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:19.656704 31257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:19.656951 31257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:19.658995 31257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "4b5efe21879048469a41537fb3878dea"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "33740fd47d74a1a48b9b6adb99b794e0"
server_key_iv: "df2bb556a935a506a587f23a3fcc4a29"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.659554 31257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "4b5efe21879048469a41537fb3878dea"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "33740fd47d74a1a48b9b6adb99b794e0"
server_key_iv: "df2bb556a935a506a587f23a3fcc4a29"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.663321 31257 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:43:19.665645 31272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.666760 31257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:19.666898 31257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "4b5efe21879048469a41537fb3878dea"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "33740fd47d74a1a48b9b6adb99b794e0"
server_key_iv: "df2bb556a935a506a587f23a3fcc4a29"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.666992 31257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:19.684283 31257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:19.687693 31257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:19.687937 31257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:19.688549 31257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:19.689453 31257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:19.689499 31257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.689568 31257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:19.689599 31257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.700711 31257 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:34655
I20260923 14:43:19.700769 31385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:34655 every 8 connection(s)
I20260923 14:43:19.701627 31257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:43:19.711256 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31257
I20260923 14:43:19.711404 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:19.711705 17426 external_mini_cluster.cc:1428] Setting key 195e25fe575e8b8ea1b140f1b39dbeca
I20260923 14:43:19.715986 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:19.703447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:44351 (local address 127.17.4.190:44477)
0923 14:43:19.703593 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:19.703597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:19.704577 (+ 980us) server_negotiation.cc:407] Connection header received
0923 14:43:19.705944 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:19.705947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:19.706004 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:19.706119 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:19.707311 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.707923 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.709069 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.709319 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.709434 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:19.712144 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:19.712148 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:19.712150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:19.712179 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:19.713637 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:19.714287 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:19.714290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:19.714291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:19.714363 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:19.714748 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:19.714750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:19.714751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:19.715002 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:19.715108 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:19.715599 (+ 491us) server_negotiation.cc:299] Negotiation successful
0923 14:43:19.715756 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 14:43:19.716840 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:19.703942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:44351)
0923 14:43:19.704406 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:19.704448 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:19.705731 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:19.706300 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:19.706306 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:19.706675 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:19.707160 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:19.707174 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.708056 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.708060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:19.708939 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:19.708948 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.709476 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.709480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:19.709645 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:19.710270 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:19.710286 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:19.711969 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:19.713771 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:19.713780 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:19.713798 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:19.714181 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:19.714450 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:19.714456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:19.714461 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:19.714654 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:19.715113 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:19.715119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:19.715361 (+ 242us) client_negotiation.cc:769] Sending connection context
0923 14:43:19.715521 (+ 160us) client_negotiation.cc:240] Negotiation successful
0923 14:43:19.715855 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":116,"threads_started":1}
I20260923 14:43:19.718103 31386 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44477
I20260923 14:43:19.718338 31386 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:19.718829 31386 heartbeater.cc:511] Master 127.17.4.190:44477 requested a full tablet report, sending...
I20260923 14:43:19.720396 31195 ts_manager.cc:194] Registered new tserver with Master: 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655)
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:43:19.721596 31195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:44351
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:43:19.738667 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44477
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:19.850576 31391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:19.850816 31391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:19.850857 31391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:19.854862 31391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:19.854912 31391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:19.854966 31391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:43:19.860059 31391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:19.860971 31391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:19.861883 31391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:19.870854 31397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:19.870937 31399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:19.870903 31391 server_base.cc:1034] running on GCE node
W20260923 14:43:19.870867 31396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:19.871433 31391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:19.872073 31391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:19.873231 31391 hybrid_clock.cc:648] HybridClock initialized: now 1790174599873216 us; error 27 us; skew 500 ppm
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:19.876015 31391 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:43:19.876856 31391 webserver.cc:460] Webserver started at http://127.17.4.130:43311/ using document root <none> and password file <none>
I20260923 14:43:19.877341 31391 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:19.877395 31391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:19.877547 31391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:19.879426 31391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "21c58430115f4a24bd76c63933534a65"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "1a66585235679e25ccfb7daff74ded8a"
server_key_iv: "a1d8ee6b4ce1a3b887a0157f7945aa38"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.880000 31391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "21c58430115f4a24bd76c63933534a65"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "1a66585235679e25ccfb7daff74ded8a"
server_key_iv: "a1d8ee6b4ce1a3b887a0157f7945aa38"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.883499 31391 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:43:19.885883 31406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.887051 31391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:19.887195 31391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "21c58430115f4a24bd76c63933534a65"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "1a66585235679e25ccfb7daff74ded8a"
server_key_iv: "a1d8ee6b4ce1a3b887a0157f7945aa38"
server_key_version: "encryptionkey@0"
I20260923 14:43:19.887326 31391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:19.903297 31391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:19.906461 31391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:19.906661 31391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:19.907231 31391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:19.908073 31391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:19.908146 31391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.908208 31391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:19.908248 31391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:19.916738 31391 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39223
I20260923 14:43:19.916777 31520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39223 every 8 connection(s)
I20260923 14:43:19.917580 31391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:43:19.924875 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31391
I20260923 14:43:19.925010 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:43:19.925308 17426 external_mini_cluster.cc:1428] Setting key 304c72781f4db40fe6d15785dd67c7a0
Sep 23 14:43:19 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174599, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:19.931433 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:19.919319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:46067 (local address 127.17.4.190:44477)
0923 14:43:19.919448 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:19.919451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:19.920281 (+ 830us) server_negotiation.cc:407] Connection header received
0923 14:43:19.921630 (+ 1349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:19.921633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:19.921693 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:19.921808 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:19.922932 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.923456 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.924665 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.924897 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.925012 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:19.927601 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:19.927611 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:19.927614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:19.927636 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:19.929191 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:19.929760 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:19.929766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:19.929770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:19.929881 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:19.930279 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:19.930285 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:19.930290 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:19.930546 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:19.930654 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:19.931118 (+ 464us) server_negotiation.cc:299] Negotiation successful
0923 14:43:19.931251 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:43:19.932456 31523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:19.919620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:46067)
0923 14:43:19.920117 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:19.920159 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:19.921419 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:19.921983 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:19.921989 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:19.922335 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:19.922787 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:19.922800 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.923597 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.923606 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:19.924520 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:19.924530 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:19.925048 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:19.925053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:19.925222 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:19.925842 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:19.925858 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:19.927423 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:19.929312 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:19.929321 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:19.929339 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:19.929635 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:19.930029 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:19.930032 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:19.930034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:19.930187 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:19.930657 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:19.930662 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:19.930881 (+ 219us) client_negotiation.cc:769] Sending connection context
0923 14:43:19.931035 (+ 154us) client_negotiation.cc:240] Negotiation successful
0923 14:43:19.931287 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":177,"threads_started":1}
I20260923 14:43:19.933698 31521 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44477
I20260923 14:43:19.933926 31521 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:19.934382 31521 heartbeater.cc:511] Master 127.17.4.190:44477 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:43:19.935386 31195 ts_manager.cc:194] Registered new tserver with Master: 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223)
I20260923 14:43:19.935992 31195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:46067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:43:19.952809 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44477
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:20.060688 31526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:20.060966 31526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:20.061040 31526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:20.065073 31526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:20.065148 31526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:20.065245 31526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:43:20.070675 31526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:20.071728 31526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:20.072737 31526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:20.082125 31534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:20.082144 31531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:20.082351 31526 server_base.cc:1034] running on GCE node
W20260923 14:43:20.082333 31532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:20.082809 31526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:20.083403 31526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:20.084561 31526 hybrid_clock.cc:648] HybridClock initialized: now 1790174600084533 us; error 37 us; skew 500 ppm
Sep 23 14:43:20 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174600, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:20.087236 31526 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:43:20.088138 31526 webserver.cc:460] Webserver started at http://127.17.4.131:36807/ using document root <none> and password file <none>
I20260923 14:43:20.088701 31526 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:20.088786 31526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:20.089002 31526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:20.091452 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "b416ce7a517447d09b664f310a5ce927"
format_stamp: "Formatted at 2026-09-23 14:43:20 on dist-test-slave-54kg"
server_key: "964181e91aeaef21910c503bcaa4d86a"
server_key_iv: "9b1bdce0ffd5d4da5cd368af5077290b"
server_key_version: "encryptionkey@0"
I20260923 14:43:20.092038 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "b416ce7a517447d09b664f310a5ce927"
format_stamp: "Formatted at 2026-09-23 14:43:20 on dist-test-slave-54kg"
server_key: "964181e91aeaef21910c503bcaa4d86a"
server_key_iv: "9b1bdce0ffd5d4da5cd368af5077290b"
server_key_version: "encryptionkey@0"
I20260923 14:43:20.095600 31526 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:43:20.098631 31541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:20.100091 31526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:43:20.100188 31526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b416ce7a517447d09b664f310a5ce927"
format_stamp: "Formatted at 2026-09-23 14:43:20 on dist-test-slave-54kg"
server_key: "964181e91aeaef21910c503bcaa4d86a"
server_key_iv: "9b1bdce0ffd5d4da5cd368af5077290b"
server_key_version: "encryptionkey@0"
I20260923 14:43:20.100270 31526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:20.117244 31526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:20.119995 31526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:20.120141 31526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:20.120653 31526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:20.121385 31526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:20.121429 31526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:20.121465 31526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:20.121481 31526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:20.129844 31526 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:45329
I20260923 14:43:20.129927 31655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:45329 every 8 connection(s)
I20260923 14:43:20.130784 31526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:43:20.138386 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31526
I20260923 14:43:20.138545 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:43:20.138840 17426 external_mini_cluster.cc:1428] Setting key bc6babc330c0c50bbb267a11e08ef240
Sep 23 14:43:20 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174600, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:20.144342 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.132593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:41841 (local address 127.17.4.190:44477)
0923 14:43:20.132729 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.132733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.133482 (+ 749us) server_negotiation.cc:407] Connection header received
0923 14:43:20.134738 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.134740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.134788 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.134860 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:20.136226 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.136763 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.137969 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.138266 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.138375 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.141082 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:20.141086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:20.141089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:20.141113 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:20.142326 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.142819 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.142824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.142826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.142906 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.143256 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.143260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.143262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.143438 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:20.143540 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.144060 (+ 520us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.144183 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:43:20.145083 31658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.132886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:41841)
0923 14:43:20.133324 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.133365 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.134547 (+ 1182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.135216 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.135224 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.135599 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:20.136094 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.136107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.136877 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.136879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.137861 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.137870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.138424 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.138427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.138659 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.139283 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:20.139299 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:20.140938 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:20.142440 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:20.142446 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:20.142460 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:20.142713 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:20.143004 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:20.143007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:20.143009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:20.143163 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:20.143546 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:20.143554 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:20.143835 (+ 281us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.144018 (+ 183us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.144313 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
I20260923 14:43:20.146158 31656 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44477
I20260923 14:43:20.146392 31656 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:20.146888 31656 heartbeater.cc:511] Master 127.17.4.190:44477 requested a full tablet report, sending...
I20260923 14:43:20.147949 31195 ts_manager.cc:194] Registered new tserver with Master: b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
I20260923 14:43:20.148486 31195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:41841
I20260923 14:43:20.152577 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:43:20.161228 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.154394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46108 (local address 127.17.4.190:44477)
0923 14:43:20.154525 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.154530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.154652 (+ 122us) server_negotiation.cc:407] Connection header received
0923 14:43:20.154746 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.154748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.154782 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.154844 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:20.155469 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.156010 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.156809 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.157003 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.157073 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.158445 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:20.158448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:20.158450 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:20.158468 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:20.159634 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.160059 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.160065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.160070 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.160164 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.160414 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.160420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.160425 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.160630 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:20.160760 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.160994 (+ 234us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.161080 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:43:20.163831 31195 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:43:20.166723 31195 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:43:20.180968 31670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.175482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48902 (local address 127.17.4.129:34655)
0923 14:43:20.176706 (+ 1224us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.176727 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.176744 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:43:20.176802 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.176805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.176974 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.177119 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:20.177451 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.178314 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.179690 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.180281 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.180402 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.180544 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.180716 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.180802 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1095,"thread_start_us":69,"threads_started":1}
I20260923 14:43:20.180958 31667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.174942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34655 (local address 127.0.0.1:48902)
0923 14:43:20.176014 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.176026 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.176128 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.177266 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.177268 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.177282 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:20.177340 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.177343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.178463 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.178469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.179572 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.179579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.180401 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.180405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.180520 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.180556 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.180687 (+ 131us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.180802 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"thread_start_us":95,"threads_started":1}
I20260923 14:43:20.181263 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.175118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45436 (local address 127.17.4.131:45329)
0923 14:43:20.175882 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.175896 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.175919 (+ 23us) server_negotiation.cc:407] Connection header received
0923 14:43:20.175996 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.176001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.176207 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.176380 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:20.176684 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.177862 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.179501 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.180284 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.180394 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.180541 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.181005 (+ 464us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.181113 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":134,"threads_started":1}
I20260923 14:43:20.181563 31668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.174856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45329 (local address 127.0.0.1:45436)
0923 14:43:20.175602 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.175648 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.175797 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.176371 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.176377 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.176398 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:20.176557 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.176565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.178001 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.178004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.179397 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.179407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.180605 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.180609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.180773 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.180851 (+ 78us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.180923 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.181188 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":270,"spinlock_wait_cycles":5376,"thread_start_us":83,"threads_started":1}
I20260923 14:43:20.181893 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.175514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39223 (local address 127.0.0.1:40376)
0923 14:43:20.176323 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.176334 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.176449 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.176916 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.176919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.176936 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:20.177038 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.177048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.178342 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.178347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.179293 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.179303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.180605 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.180609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.180751 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.180851 (+ 100us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.180923 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.181763 (+ 840us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":125,"thread_start_us":74,"threads_started":1}
I20260923 14:43:20.182324 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.175921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40376 (local address 127.17.4.130:39223)
0923 14:43:20.176269 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.176281 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.176422 (+ 141us) server_negotiation.cc:407] Connection header received
0923 14:43:20.176571 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.176575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.176776 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.176926 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:20.177133 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.178207 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.179420 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.180290 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.180394 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.180542 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.182122 (+ 1580us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.182209 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":129,"threads_started":1}
I20260923 14:43:20.184612 31455 tablet_service.cc:1467] Processing CreateTablet for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 (DEFAULT_TABLE table=test-table [id=1428f3bf13f2409a808b418d687fdbda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:20.184634 31314 tablet_service.cc:1467] Processing CreateTablet for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 (DEFAULT_TABLE table=test-table [id=1428f3bf13f2409a808b418d687fdbda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:20.184634 31590 tablet_service.cc:1467] Processing CreateTablet for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 (DEFAULT_TABLE table=test-table [id=1428f3bf13f2409a808b418d687fdbda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:20.185561 31455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:20.185593 31590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:20.185588 31314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:20.192036 31673 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Bootstrap starting.
I20260923 14:43:20.193281 31674 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Bootstrap starting.
I20260923 14:43:20.194829 31673 tablet_bootstrap.cc:654] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:20.195472 31674 tablet_bootstrap.cc:654] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:20.195684 31673 log.cc:824] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:20.196098 31675 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Bootstrap starting.
I20260923 14:43:20.196345 31674 log.cc:824] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:20.197732 31673 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: No bootstrap required, opened a new log
I20260923 14:43:20.197944 31673 ts_tablet_manager.cc:1397] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260923 14:43:20.198180 31675 tablet_bootstrap.cc:654] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:20.198349 31674 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: No bootstrap required, opened a new log
I20260923 14:43:20.198545 31674 ts_tablet_manager.cc:1397] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:43:20.199453 31675 log.cc:824] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:20.201356 31675 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: No bootstrap required, opened a new log
I20260923 14:43:20.201531 31675 ts_tablet_manager.cc:1397] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260923 14:43:20.201452 31673 raft_consensus.cc:348] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.201756 31673 raft_consensus.cc:374] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:20.201812 31673 raft_consensus.cc:729] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c58430115f4a24bd76c63933534a65, State: Initialized, Role: FOLLOWER
I20260923 14:43:20.202279 31673 consensus_queue.cc:260] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.202276 31674 raft_consensus.cc:348] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.202525 31674 raft_consensus.cc:374] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:20.202584 31674 raft_consensus.cc:729] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b416ce7a517447d09b664f310a5ce927, State: Initialized, Role: FOLLOWER
I20260923 14:43:20.203075 31521 heartbeater.cc:503] Master 127.17.4.190:44477 was elected leader, sending a full tablet report...
I20260923 14:43:20.203060 31674 consensus_queue.cc:260] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.203538 31673 ts_tablet_manager.cc:1428] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260923 14:43:20.203845 31656 heartbeater.cc:503] Master 127.17.4.190:44477 was elected leader, sending a full tablet report...
I20260923 14:43:20.204026 31674 ts_tablet_manager.cc:1428] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260923 14:43:20.206146 31675 raft_consensus.cc:348] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.206375 31675 raft_consensus.cc:374] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:20.206436 31675 raft_consensus.cc:729] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5efe21879048469a41537fb3878dea, State: Initialized, Role: FOLLOWER
I20260923 14:43:20.206876 31675 consensus_queue.cc:260] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.207540 31386 heartbeater.cc:503] Master 127.17.4.190:44477 was elected leader, sending a full tablet report...
I20260923 14:43:20.207875 31675 ts_tablet_manager.cc:1428] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
W20260923 14:43:20.381760 31657 tablet.cc:2369] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:20.405366 31679 raft_consensus.cc:482] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:20.405575 31679 raft_consensus.cc:504] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.406689 31679 leader_election.cc:288] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329), 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655)
I20260923 14:43:20.410982 31670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.407167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:34805 (local address 127.17.4.129:34655)
0923 14:43:20.407318 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.407323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.407340 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:43:20.407406 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.407409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.407466 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.407551 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:20.407882 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.408676 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.409965 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.410382 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.410498 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.410556 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.410773 (+ 217us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.410853 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 14:43:20.411000 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.407287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:51023 (local address 127.17.4.131:45329)
0923 14:43:20.407408 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.407412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.407446 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:43:20.407497 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.407503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.407557 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.407624 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:20.407905 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.408688 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.410000 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.410403 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.410533 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.410590 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.410818 (+ 228us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.410897 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:43:20.410982 31523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.406935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34655 (local address 127.17.4.130:34805)
0923 14:43:20.407149 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.407167 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.407266 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.407566 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.407568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.407580 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:20.407731 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.407740 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.408823 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.408828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.409837 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.409847 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.410498 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.410502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.410610 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.410661 (+ 51us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.410719 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.410811 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":61}
I20260923 14:43:20.411002 31682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.406935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45329 (local address 127.17.4.130:51023)
0923 14:43:20.407290 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.407306 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.407390 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.407651 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.407654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.407665 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:20.407794 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.407803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.408813 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.408816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.409850 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.409861 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.410548 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.410551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.410669 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.410686 (+ 17us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.410789 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.410853 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":28,"thread_start_us":92,"threads_started":1}
I20260923 14:43:20.411620 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48bb8cdbe15b4b2b8e4c57ebcb6f68a8" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b416ce7a517447d09b664f310a5ce927" is_pre_election: true
I20260923 14:43:20.411831 31340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48bb8cdbe15b4b2b8e4c57ebcb6f68a8" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5efe21879048469a41537fb3878dea" is_pre_election: true
I20260923 14:43:20.411971 31610 raft_consensus.cc:2454] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 0.
I20260923 14:43:20.412122 31340 raft_consensus.cc:2454] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 0.
I20260923 14:43:20.412523 31407 leader_election.cc:302] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c58430115f4a24bd76c63933534a65, b416ce7a517447d09b664f310a5ce927; no voters:
I20260923 14:43:20.412807 31679 raft_consensus.cc:2781] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:43:20.412883 31679 raft_consensus.cc:482] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:43:20.412935 31679 raft_consensus.cc:3037] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:20.413966 31679 raft_consensus.cc:504] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.414327 31679 leader_election.cc:288] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 election: Requested vote from peers b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329), 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655)
I20260923 14:43:20.414675 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48bb8cdbe15b4b2b8e4c57ebcb6f68a8" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b416ce7a517447d09b664f310a5ce927"
I20260923 14:43:20.414667 31340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48bb8cdbe15b4b2b8e4c57ebcb6f68a8" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5efe21879048469a41537fb3878dea"
I20260923 14:43:20.414805 31610 raft_consensus.cc:3037] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:20.414821 31340 raft_consensus.cc:3037] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:20.415889 31340 raft_consensus.cc:2454] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 1.
I20260923 14:43:20.415944 31610 raft_consensus.cc:2454] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 1.
I20260923 14:43:20.416172 31409 leader_election.cc:302] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c58430115f4a24bd76c63933534a65, 4b5efe21879048469a41537fb3878dea; no voters:
I20260923 14:43:20.416349 31679 raft_consensus.cc:2781] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:20.416581 31679 raft_consensus.cc:686] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 1 LEADER]: Becoming Leader. State: Replica: 21c58430115f4a24bd76c63933534a65, State: Running, Role: LEADER
I20260923 14:43:20.416949 31679 consensus_queue.cc:237] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
W20260923 14:43:20.418668 31522 tablet.cc:2369] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:20.420298 31194 catalog_manager.cc:5495] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c58430115f4a24bd76c63933534a65 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "21c58430115f4a24bd76c63933534a65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } health_report { overall_health: HEALTHY } } }
W20260923 14:43:20.452944 31387 tablet.cc:2369] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:20.475421 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.471685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.17.4.130:39223)
0923 14:43:20.471865 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.471871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.471888 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:43:20.471995 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.471998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.472056 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.472176 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:43:20.472446 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.472967 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.473836 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.474073 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.474193 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.474523 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:43:20.474971 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:43:20.475117 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.475188 (+ 71us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.475248 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 14:43:20.481848 31610 raft_consensus.cc:1261] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Refusing update from remote peer 21c58430115f4a24bd76c63933534a65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:20.481849 31340 raft_consensus.cc:1261] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Refusing update from remote peer 21c58430115f4a24bd76c63933534a65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:20.482641 31679 consensus_queue.cc:1035] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:20.482899 31683 consensus_queue.cc:1035] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:20.490736 31686 mvcc.cc:205] Tried to move back new op lower bound from 7332555163566043136 to 7332555163310362624. Current Snapshot: MvccSnapshot[applied={T|T < 7332555163566043136}]
I20260923 14:43:20.490907 31688 mvcc.cc:205] Tried to move back new op lower bound from 7332555163566043136 to 7332555163310362624. Current Snapshot: MvccSnapshot[applied={T|T < 7332555163566043136}]
I20260923 14:43:20.499555 31194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:20.499771 31194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:20.502094 31194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Sending DeleteTablet for 3 replicas of tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8
I20260923 14:43:20.502983 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31257
I20260923 14:43:20.503114 31455 tablet_service.cc:1514] Processing DeleteTablet for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:20 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:40376
I20260923 14:43:20.503129 31590 tablet_service.cc:1514] Processing DeleteTablet for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:20 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:45436
I20260923 14:43:20.504094 31696 tablet_replica.cc:330] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: stopping tablet replica
I20260923 14:43:20.504395 31696 raft_consensus.cc:2229] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:43:20.504730 31696 raft_consensus.cc:2258] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:20.506234 31696 ts_tablet_manager.cc:1905] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:20.506595 31695 tablet_replica.cc:330] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: stopping tablet replica
I20260923 14:43:20.506958 31695 raft_consensus.cc:2229] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:43:20.507340 31695 raft_consensus.cc:2258] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:20.508971 31695 ts_tablet_manager.cc:1905] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:20.509923 31696 ts_tablet_manager.cc:1918] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:20.510032 31696 log.cc:1196] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/48bb8cdbe15b4b2b8e4c57ebcb6f68a8
I20260923 14:43:20.510536 31696 ts_tablet_manager.cc:1939] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 21c58430115f4a24bd76c63933534a65: Deleting consensus metadata
W20260923 14:43:20.510987 31181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:34655 (error 108)
I20260923 14:43:20.511830 31179 catalog_manager.cc:4841] TS 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223): tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 (table test-table [id=1428f3bf13f2409a808b418d687fdbda]) successfully deleted
I20260923 14:43:20.512288 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31391
I20260923 14:43:20.513761 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.513448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34655 (local address 127.0.0.1:48910)
0923 14:43:20.513594 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.513674 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:34655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260923 14:43:20.513937 31181 catalog_manager.cc:4584] TS 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8: Network error: Client connection negotiation failed: client connection to 127.17.4.129:34655: connect: Connection refused (error 111)
I20260923 14:43:20.514267 31695 ts_tablet_manager.cc:1918] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:20.514374 31695 log.cc:1196] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/48bb8cdbe15b4b2b8e4c57ebcb6f68a8
I20260923 14:43:20.514729 31695 ts_tablet_manager.cc:1939] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P b416ce7a517447d09b664f310a5ce927: Deleting consensus metadata
I20260923 14:43:20.515978 31179 catalog_manager.cc:4841] TS b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 (table test-table [id=1428f3bf13f2409a808b418d687fdbda]) successfully deleted
I20260923 14:43:20.518626 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31526
I20260923 14:43:20.524192 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31162
I20260923 14:43:20.530738 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44477
--webserver_interface=127.17.4.190
--webserver_port=39797
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:20.640548 31698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:20.640825 31698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:20.640903 31698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:20.644855 31698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:20.644937 31698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:20.644976 31698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:20.645032 31698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:20.645073 31698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:20.650317 31698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=39797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:20.651378 31698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:20.652405 31698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:20.666396 31704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:20.666396 31707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:20.666590 31698 server_base.cc:1034] running on GCE node
W20260923 14:43:20.666487 31705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:20.667335 31698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:20.668533 31698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:20.669723 31698 hybrid_clock.cc:648] HybridClock initialized: now 1790174600669705 us; error 31 us; skew 500 ppm
Sep 23 14:43:20 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174600, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:20.672533 31698 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:20.673437 31698 webserver.cc:460] Webserver started at http://127.17.4.190:39797/ using document root <none> and password file <none>
I20260923 14:43:20.674038 31698 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:20.674157 31698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:20.678038 31698 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260923 14:43:20.680182 31714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:20.681382 31698 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:20.681530 31698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "157803083f0d4f4795c1acc12ee1ae09"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "b6c36f36a2313cb4fe6d88a4f9d8667e"
server_key_iv: "6d759e29ff37802a4ae6063c0e52c45b"
server_key_version: "encryptionkey@0"
I20260923 14:43:20.682120 31698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:20.698139 31698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:20.701566 31698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:20.701784 31698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:20.708817 31698 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44477
I20260923 14:43:20.709113 31766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44477 every 8 connection(s)
I20260923 14:43:20.709949 31698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:20.714416 31767 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:43:20.716080 31767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap starting.
I20260923 14:43:20.717197 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31698
I20260923 14:43:20.717739 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:34655
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:44477
--webserver_port=40081
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:20.735040 31767 log.cc:824] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:20.744518 31767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:43:20.744910 31767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap complete.
I20260923 14:43:20.749022 31767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:20.749394 31767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 157803083f0d4f4795c1acc12ee1ae09, State: Initialized, Role: FOLLOWER
I20260923 14:43:20.749862 31767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:20.750043 31767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:20.750121 31767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:20.750243 31767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 1 FOLLOWER]: Advancing to term 2
I20260923 14:43:20.752295 31767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:20.752636 31767 leader_election.cc:302] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 157803083f0d4f4795c1acc12ee1ae09; no voters:
I20260923 14:43:20.752971 31767 leader_election.cc:288] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 14:43:20.753144 31771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 14:43:20.753405 31771 raft_consensus.cc:686] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 LEADER]: Becoming Leader. State: Replica: 157803083f0d4f4795c1acc12ee1ae09, State: Running, Role: LEADER
I20260923 14:43:20.753712 31771 consensus_queue.cc:237] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:20.754351 31767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:20.754733 31771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 157803083f0d4f4795c1acc12ee1ae09. Latest consensus state: current_term: 2 leader_uuid: "157803083f0d4f4795c1acc12ee1ae09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } } }
I20260923 14:43:20.754846 31771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:20.755429 31772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "157803083f0d4f4795c1acc12ee1ae09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } } }
I20260923 14:43:20.755518 31772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:20.756191 31775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:20.760998 31775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:20.761827 31775 catalog_manager.cc:1259] Loaded cluster ID: f2e84247c0824a079188073ac3ebb201
I20260923 14:43:20.761885 31775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:20.763284 31775 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260923 14:43:20.767946 31775 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260923 14:43:20.773663 31775 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:20.774480 31775 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Loaded TSK: 0
I20260923 14:43:20.775748 31775 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 14:43:20.839098 31769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:20.839376 31769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:20.839423 31769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:20.843578 31769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:20.843652 31769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:20.843710 31769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:43:20.849035 31769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:34655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=40081
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:20.850104 31769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:20.851136 31769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:20.861224 31796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:20.861218 31795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:20.861693 31798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:20.861757 31769 server_base.cc:1034] running on GCE node
I20260923 14:43:20.862147 31769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:20.862977 31769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:20.864147 31769 hybrid_clock.cc:648] HybridClock initialized: now 1790174600864120 us; error 51 us; skew 500 ppm
Sep 23 14:43:20 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174600, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:20.867012 31769 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:43:20.868062 31769 webserver.cc:460] Webserver started at http://127.17.4.129:40081/ using document root <none> and password file <none>
I20260923 14:43:20.868620 31769 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:20.868726 31769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:20.872566 31769 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:43:20.874784 31805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:20.876222 31769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 14:43:20.876360 31769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "4b5efe21879048469a41537fb3878dea"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "33740fd47d74a1a48b9b6adb99b794e0"
server_key_iv: "df2bb556a935a506a587f23a3fcc4a29"
server_key_version: "encryptionkey@0"
I20260923 14:43:20.876955 31769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:20.917568 31769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:20.920981 31769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:20.921200 31769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:20.921813 31769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:20.922919 31812 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 14:43:20.927208 31769 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 14:43:20.927310 31769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260923 14:43:20.927397 31769 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 14:43:20.929105 31769 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 14:43:20.929179 31769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260923 14:43:20.929422 31812 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Bootstrap starting.
I20260923 14:43:20.939807 31769 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:34655
I20260923 14:43:20.939888 31919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:34655 every 8 connection(s)
I20260923 14:43:20.940833 31769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:43:20.945500 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31769
I20260923 14:43:20.945952 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:39223
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:44477
--webserver_port=43311
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:20.948284 31812 log.cc:824] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Log is configured to *not* fsync() on all Append() calls
Sep 23 14:43:20 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174600, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:20.958523 31812 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:43:20.958981 31812 tablet_bootstrap.cc:492] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Bootstrap complete.
I20260923 14:43:20.959617 31922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.942883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:43947 (local address 127.17.4.190:44477)
0923 14:43:20.943388 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.943410 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.944111 (+ 701us) server_negotiation.cc:407] Connection header received
0923 14:43:20.945253 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.945270 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.945732 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.946162 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:20.947937 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.949213 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.950499 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.950967 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.951160 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.954360 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:20.954364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:20.954376 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:20.954403 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:20.956377 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.956983 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.956994 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.956997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.957110 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.957460 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.957463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.957465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.957808 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:20.957952 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.958489 (+ 537us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.958868 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":139,"threads_started":1}
I20260923 14:43:20.959640 31923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.942912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:43947)
0923 14:43:20.943940 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.943981 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.944773 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.946456 (+ 1683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.946467 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.947009 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:20.947680 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.947697 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.949431 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.949434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.950373 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.950384 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.951129 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.951133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.951312 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.951951 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:20.951967 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:20.954120 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:20.956508 (+ 2388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:20.956514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:20.956527 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:20.956856 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:20.957210 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:20.957213 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:20.957215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:20.957356 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:20.957923 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:20.957929 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:20.958189 (+ 260us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.958365 (+ 176us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.958703 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"thread_start_us":159,"threads_started":1}
I20260923 14:43:20.960530 31812 ts_tablet_manager.cc:1397] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Time spent bootstrapping tablet: real 0.031s user 0.023s sys 0.007s
I20260923 14:43:20.962270 31920 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44477
I20260923 14:43:20.962514 31920 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:20.962996 31920 heartbeater.cc:511] Master 127.17.4.190:44477 requested a full tablet report, sending...
I20260923 14:43:20.963481 31812 raft_consensus.cc:348] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.964041 31812 raft_consensus.cc:729] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5efe21879048469a41537fb3878dea, State: Initialized, Role: FOLLOWER
I20260923 14:43:20.964552 31812 consensus_queue.cc:260] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } } peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } }
I20260923 14:43:20.965554 31731 ts_manager.cc:194] Registered new tserver with Master: 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655)
I20260923 14:43:20.965584 31812 ts_tablet_manager.cc:1428] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:43:20.969167 31731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:43947
I20260923 14:43:20.972126 31920 heartbeater.cc:503] Master 127.17.4.190:44477 was elected leader, sending a full tablet report...
Sep 23 14:43:20 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174600, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:43:20.979084 31928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.968363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48914 (local address 127.17.4.129:34655)
0923 14:43:20.969064 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:20.969075 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:20.969098 (+ 23us) server_negotiation.cc:407] Connection header received
0923 14:43:20.969167 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:20.969172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:20.969367 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:20.969506 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:20.970246 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.971062 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.972137 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.972624 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.972746 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.975142 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:20.975151 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:20.975164 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:20.975194 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:20.976882 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.977438 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.977446 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.977451 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.977550 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:20.977897 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:20.977902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:20.977905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:20.978286 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:20.978426 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:20.978807 (+ 381us) server_negotiation.cc:299] Negotiation successful
0923 14:43:20.978943 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":121,"threads_started":1}
I20260923 14:43:20.979120 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:20.968293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34655 (local address 127.0.0.1:48914)
0923 14:43:20.968746 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:20.968792 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:20.968911 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:20.969534 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:20.969541 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:20.970000 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:20.970126 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.970133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.971176 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.971180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.972016 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:20.972027 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:20.972752 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:20.972756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:20.972871 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:20.973469 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:20.973481 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:20.974994 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:20.977002 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:20.977012 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:20.977018 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:20.977246 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:20.977650 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:20.977669 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:20.977671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:20.977789 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:20.978429 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:20.978435 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:20.978580 (+ 145us) client_negotiation.cc:769] Sending connection context
0923 14:43:20.978730 (+ 150us) client_negotiation.cc:240] Negotiation successful
0923 14:43:20.978951 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":119,"threads_started":1}
I20260923 14:43:20.980144 31854 tablet_service.cc:1514] Processing DeleteTablet for tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:20 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:48914
I20260923 14:43:20.981006 31929 tablet_replica.cc:330] stopping tablet replica
I20260923 14:43:20.981351 31929 raft_consensus.cc:2229] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:43:20.981601 31929 raft_consensus.cc:2258] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:20.982535 31929 ts_tablet_manager.cc:1905] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:20.986370 31929 ts_tablet_manager.cc:1918] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:20.986486 31929 log.cc:1196] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/48bb8cdbe15b4b2b8e4c57ebcb6f68a8
I20260923 14:43:20.986755 31929 ts_tablet_manager.cc:1939] T 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 P 4b5efe21879048469a41537fb3878dea: Deleting consensus metadata
I20260923 14:43:20.988538 31717 catalog_manager.cc:4841] TS 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655): tablet 48bb8cdbe15b4b2b8e4c57ebcb6f68a8 (table test-table [id=1428f3bf13f2409a808b418d687fdbda]) successfully deleted
W20260923 14:43:21.067854 31924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:21.068125 31924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:21.068168 31924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:21.072273 31924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:21.072336 31924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:21.072397 31924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:43:21.077657 31924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:39223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=43311
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:21.078657 31924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:21.079623 31924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:21.089661 31937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.089718 31934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.089728 31935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:21.089826 31924 server_base.cc:1034] running on GCE node
I20260923 14:43:21.090215 31924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:21.090868 31924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:21.092026 31924 hybrid_clock.cc:648] HybridClock initialized: now 1790174601092009 us; error 32 us; skew 500 ppm
Sep 23 14:43:21 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:21.094938 31924 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:43:21.095954 31924 webserver.cc:460] Webserver started at http://127.17.4.130:43311/ using document root <none> and password file <none>
I20260923 14:43:21.096551 31924 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:21.096665 31924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:21.101317 31924 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:43:21.103840 31944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.105134 31924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 14:43:21.105258 31924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "21c58430115f4a24bd76c63933534a65"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "1a66585235679e25ccfb7daff74ded8a"
server_key_iv: "a1d8ee6b4ce1a3b887a0157f7945aa38"
server_key_version: "encryptionkey@0"
I20260923 14:43:21.105810 31924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:21.118438 31924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:21.121785 31924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:21.122027 31924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:21.122624 31924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:21.123476 31924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:21.123531 31924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.123600 31924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:21.123636 31924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.132704 31924 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39223
I20260923 14:43:21.132741 32058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39223 every 8 connection(s)
I20260923 14:43:21.133697 31924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
Sep 23 14:43:21 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:21.143412 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 31924
I20260923 14:43:21.143863 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:45329
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:44477
--webserver_port=36807
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:21.147908 31922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.135683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:44485 (local address 127.17.4.190:44477)
0923 14:43:21.135875 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.135879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.136705 (+ 826us) server_negotiation.cc:407] Connection header received
0923 14:43:21.138080 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.138083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.138147 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.138252 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:21.139417 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.140062 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.141198 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.141436 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.141552 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.144016 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:21.144020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:21.144022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:21.144047 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:21.145623 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:21.146245 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:21.146248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:21.146249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:21.146321 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:21.146706 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:21.146708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:21.146709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:21.146877 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:21.146950 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.147562 (+ 612us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.147723 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 14:43:21.149072 32061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.136109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:44485)
0923 14:43:21.136552 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.136592 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.137851 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.138433 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:21.138440 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:21.138791 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:21.139255 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.139269 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.140194 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.140199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.141063 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.141073 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.141590 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.141594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.141768 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.142321 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:21.142336 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:21.143855 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:21.145744 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:21.145756 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:21.145773 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:21.146140 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:21.146414 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:21.146420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:21.146425 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:21.146615 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:21.146981 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:21.146990 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:21.147304 (+ 314us) client_negotiation.cc:769] Sending connection context
0923 14:43:21.147531 (+ 227us) client_negotiation.cc:240] Negotiation successful
0923 14:43:21.147931 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":104,"threads_started":1}
I20260923 14:43:21.150350 32059 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44477
I20260923 14:43:21.150593 32059 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:21.151069 32059 heartbeater.cc:511] Master 127.17.4.190:44477 requested a full tablet report, sending...
I20260923 14:43:21.152155 31731 ts_manager.cc:194] Registered new tserver with Master: 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223)
I20260923 14:43:21.152729 31731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:44485
W20260923 14:43:21.254648 32062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:21.254928 32062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:21.255036 32062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:21.259313 32062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:21.259409 32062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:21.259496 32062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:43:21.264830 32062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:45329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=36807
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:21.265853 32062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:21.266839 32062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:21.276086 32070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.276122 32068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.276122 32067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:21.276271 32062 server_base.cc:1034] running on GCE node
I20260923 14:43:21.276721 32062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:21.277347 32062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:21.278533 32062 hybrid_clock.cc:648] HybridClock initialized: now 1790174601278518 us; error 28 us; skew 500 ppm
Sep 23 14:43:21 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:21.281412 32062 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:43:21.282305 32062 webserver.cc:460] Webserver started at http://127.17.4.131:36807/ using document root <none> and password file <none>
I20260923 14:43:21.282848 32062 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:21.282953 32062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:21.286970 32062 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260923 14:43:21.289052 32077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.290273 32062 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:43:21.290410 32062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b416ce7a517447d09b664f310a5ce927"
format_stamp: "Formatted at 2026-09-23 14:43:20 on dist-test-slave-54kg"
server_key: "964181e91aeaef21910c503bcaa4d86a"
server_key_iv: "9b1bdce0ffd5d4da5cd368af5077290b"
server_key_version: "encryptionkey@0"
I20260923 14:43:21.290946 32062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:21.313053 32062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:21.316093 32062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:21.316316 32062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:21.316926 32062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:21.317749 32062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:21.317821 32062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.317891 32062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:21.317942 32062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.326694 32062 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:45329
I20260923 14:43:21.326761 32191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:45329 every 8 connection(s)
I20260923 14:43:21.327736 32062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:43:21.330668 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 32062
Sep 23 14:43:21 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:21.339819 32195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.331347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46124 (local address 127.17.4.190:44477)
0923 14:43:21.331582 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.331587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.331780 (+ 193us) server_negotiation.cc:407] Connection header received
0923 14:43:21.331953 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.331961 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.332004 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.332101 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:21.332839 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.333474 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.334339 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.334569 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.334675 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.336261 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:21.336268 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:21.336274 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:21.336303 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:21.337968 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:21.338377 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:21.338382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:21.338384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:21.338482 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:21.338774 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:21.338778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:21.338780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:21.338951 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:21.339167 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.339389 (+ 222us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.339552 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
I20260923 14:43:21.342258 31922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.329530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:48439 (local address 127.17.4.190:44477)
0923 14:43:21.329706 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.329712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.330517 (+ 805us) server_negotiation.cc:407] Connection header received
0923 14:43:21.332206 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.332209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.332256 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.332337 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:21.333563 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.334036 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.335213 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.335547 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.335657 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.338027 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:21.338032 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:21.338038 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:21.338066 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:21.339483 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:21.340378 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:21.340383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:21.340385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:21.340484 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:21.341017 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:21.341020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:21.341080 (+ 60us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:21.341358 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:21.341483 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.342033 (+ 550us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.342155 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 14:43:21.343112 32194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.329922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:48439)
0923 14:43:21.330355 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.330413 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.331993 (+ 1580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.332514 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:21.332521 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:21.332851 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:21.333414 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.333429 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.334162 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.334165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.335073 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.335084 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.335708 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.335711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.335911 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.336463 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:21.336478 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:21.337874 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:21.339654 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:21.339660 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:21.339675 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:21.340244 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:21.340727 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:21.340730 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:21.340732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:21.340898 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:21.341483 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:21.341491 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:21.341747 (+ 256us) client_negotiation.cc:769] Sending connection context
0923 14:43:21.341937 (+ 190us) client_negotiation.cc:240] Negotiation successful
0923 14:43:21.342281 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":114,"threads_started":1}
I20260923 14:43:21.344400 32192 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44477
I20260923 14:43:21.344731 32192 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:21.345229 32192 heartbeater.cc:511] Master 127.17.4.190:44477 requested a full tablet report, sending...
I20260923 14:43:21.346151 31731 ts_manager.cc:194] Registered new tserver with Master: b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
I20260923 14:43:21.346704 31731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:48439
I20260923 14:43:21.353857 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:43:21.358642 31922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.354525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.17.4.190:44477)
0923 14:43:21.354691 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.354697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.354918 (+ 221us) server_negotiation.cc:407] Connection header received
0923 14:43:21.355103 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.355106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.355201 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.355328 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:43:21.355586 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.356194 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.357131 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.357439 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.357550 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.357876 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:43:21.358255 (+ 379us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:43:21.358387 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.358448 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.358500 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:43:21.359272 31731 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:46136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:43:21.362531 31731 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:43:21.370220 31854 tablet_service.cc:1467] Processing CreateTablet for tablet 46bf4db557a240f2ac889c1d3f8e80b6 (DEFAULT_TABLE table=test-table [id=365b7f9e2d834b0a95e13a4d1ed9bbca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:21.370862 31854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46bf4db557a240f2ac889c1d3f8e80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:21.373466 31812 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Bootstrap starting.
I20260923 14:43:21.374313 31812 tablet_bootstrap.cc:654] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:21.375180 32202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.369328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45329 (local address 127.0.0.1:45444)
0923 14:43:21.369673 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.369684 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.369784 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.370621 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:21.370624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:21.370643 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:21.370740 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.370750 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.371896 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.371899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.373605 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.373614 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.374714 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.374718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.374827 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.374874 (+ 47us) client_negotiation.cc:769] Sending connection context
0923 14:43:21.374961 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 14:43:21.375032 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":31,"thread_start_us":105,"threads_started":1}
I20260923 14:43:21.375288 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.369620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45444 (local address 127.17.4.131:45329)
0923 14:43:21.370209 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.370218 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.370235 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:43:21.370296 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.370299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.370480 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.370636 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:21.370868 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.371653 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.373725 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.374578 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.374708 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.374874 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.375021 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.375114 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":115,"threads_started":1}
I20260923 14:43:21.375914 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.369083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39223 (local address 127.0.0.1:40398)
0923 14:43:21.369212 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.369228 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.369313 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.370508 (+ 1195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:21.370511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:21.370527 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:21.370631 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.370637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.372091 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.372094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.373400 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.373412 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.375473 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.375477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.375576 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.375603 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 14:43:21.375659 (+ 56us) client_negotiation.cc:240] Negotiation successful
0923 14:43:21.375745 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":21}
I20260923 14:43:21.375932 31812 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: No bootstrap required, opened a new log
I20260923 14:43:21.376009 31812 ts_tablet_manager.cc:1397] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260923 14:43:21.376514 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.369278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40398 (local address 127.17.4.130:39223)
0923 14:43:21.370018 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.370030 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.370052 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:43:21.370125 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.370131 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.370339 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.370782 (+ 443us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:21.370930 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.371962 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.374518 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.375329 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.376113 (+ 784us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.376274 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.376321 (+ 47us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.376390 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":125,"threads_started":1}
I20260923 14:43:21.376474 31812 raft_consensus.cc:348] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.376600 31812 raft_consensus.cc:374] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:21.376636 31812 raft_consensus.cc:729] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5efe21879048469a41537fb3878dea, State: Initialized, Role: FOLLOWER
I20260923 14:43:21.376758 31812 consensus_queue.cc:260] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.376995 31812 ts_tablet_manager.cc:1428] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 14:43:21.378980 32125 tablet_service.cc:1467] Processing CreateTablet for tablet 46bf4db557a240f2ac889c1d3f8e80b6 (DEFAULT_TABLE table=test-table [id=365b7f9e2d834b0a95e13a4d1ed9bbca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:21.379302 31993 tablet_service.cc:1467] Processing CreateTablet for tablet 46bf4db557a240f2ac889c1d3f8e80b6 (DEFAULT_TABLE table=test-table [id=365b7f9e2d834b0a95e13a4d1ed9bbca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:21.380128 32125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46bf4db557a240f2ac889c1d3f8e80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:21.380228 31993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46bf4db557a240f2ac889c1d3f8e80b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:21.388145 32206 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Bootstrap starting.
I20260923 14:43:21.388145 32205 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Bootstrap starting.
I20260923 14:43:21.390640 32206 tablet_bootstrap.cc:654] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:21.391158 32205 tablet_bootstrap.cc:654] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:21.392069 32205 log.cc:824] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:21.392069 32206 log.cc:824] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:21.394258 32205 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: No bootstrap required, opened a new log
I20260923 14:43:21.394258 32206 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: No bootstrap required, opened a new log
I20260923 14:43:21.394457 32206 ts_tablet_manager.cc:1397] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260923 14:43:21.394457 32205 ts_tablet_manager.cc:1397] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260923 14:43:21.398546 32206 raft_consensus.cc:348] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.398546 32205 raft_consensus.cc:348] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.398833 32205 raft_consensus.cc:374] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:21.398833 32206 raft_consensus.cc:374] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:21.398901 32206 raft_consensus.cc:729] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b416ce7a517447d09b664f310a5ce927, State: Initialized, Role: FOLLOWER
I20260923 14:43:21.398901 32205 raft_consensus.cc:729] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c58430115f4a24bd76c63933534a65, State: Initialized, Role: FOLLOWER
I20260923 14:43:21.399386 32206 consensus_queue.cc:260] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.399386 32205 consensus_queue.cc:260] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.400146 32192 heartbeater.cc:503] Master 127.17.4.190:44477 was elected leader, sending a full tablet report...
I20260923 14:43:21.400147 32059 heartbeater.cc:503] Master 127.17.4.190:44477 was elected leader, sending a full tablet report...
I20260923 14:43:21.400489 32205 ts_tablet_manager.cc:1428] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 14:43:21.400998 32206 ts_tablet_manager.cc:1428] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260923 14:43:21.442186 31921 tablet.cc:2369] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:43:21.451829 32209 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:21.452056 32209 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.453313 32209 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329), 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655)
I20260923 14:43:21.457275 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.453608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:52391 (local address 127.17.4.131:45329)
0923 14:43:21.453750 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.453757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.453778 (+ 21us) server_negotiation.cc:407] Connection header received
0923 14:43:21.453854 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.453857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.453951 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.454034 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:21.454344 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.455063 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.456314 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.456732 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.456859 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.456913 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.457083 (+ 170us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.457146 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 14:43:21.457275 32061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.453500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45329 (local address 127.17.4.130:52391)
0923 14:43:21.453608 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.453625 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.453730 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.454066 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:21.454069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:21.454090 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:21.454231 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.454240 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.455166 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.455172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.456197 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.456208 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.456852 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.456856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.456956 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.456983 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 14:43:21.457068 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 14:43:21.457137 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260923 14:43:21.457579 32211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.453568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34655 (local address 127.17.4.130:50733)
0923 14:43:21.454075 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.454087 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.454197 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.454583 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:21.454586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:21.454599 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:21.454716 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.454725 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.455572 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.455578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.456494 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:21.456517 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.457203 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.457207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:21.457299 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.457319 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:43:21.457381 (+ 62us) client_negotiation.cc:240] Negotiation successful
0923 14:43:21.457447 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":161,"threads_started":1}
I20260923 14:43:21.457588 31928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.453815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:50733 (local address 127.17.4.129:34655)
0923 14:43:21.453961 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.453966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.454202 (+ 236us) server_negotiation.cc:407] Connection header received
0923 14:43:21.454309 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.454312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.454377 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.454489 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:21.454864 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.455438 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.456635 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.457073 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.457209 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.457378 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.457413 (+ 35us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.457476 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 14:43:21.458160 31874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46bf4db557a240f2ac889c1d3f8e80b6" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5efe21879048469a41537fb3878dea" is_pre_election: true
I20260923 14:43:21.458212 32146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46bf4db557a240f2ac889c1d3f8e80b6" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b416ce7a517447d09b664f310a5ce927" is_pre_election: true
I20260923 14:43:21.458451 32146 raft_consensus.cc:2454] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 0.
I20260923 14:43:21.458452 31874 raft_consensus.cc:2454] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 0.
I20260923 14:43:21.458894 31947 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 21c58430115f4a24bd76c63933534a65, 4b5efe21879048469a41537fb3878dea, b416ce7a517447d09b664f310a5ce927; no voters:
I20260923 14:43:21.459142 32209 raft_consensus.cc:2781] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:43:21.459220 32209 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:43:21.459264 32209 raft_consensus.cc:3037] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:21.460371 32209 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.460685 32209 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 election: Requested vote from peers b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329), 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655)
I20260923 14:43:21.460996 32146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46bf4db557a240f2ac889c1d3f8e80b6" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b416ce7a517447d09b664f310a5ce927"
I20260923 14:43:21.461022 31874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46bf4db557a240f2ac889c1d3f8e80b6" candidate_uuid: "21c58430115f4a24bd76c63933534a65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5efe21879048469a41537fb3878dea"
I20260923 14:43:21.461148 31874 raft_consensus.cc:3037] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:21.461125 32146 raft_consensus.cc:3037] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:21.462142 31874 raft_consensus.cc:2454] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 1.
I20260923 14:43:21.462204 32146 raft_consensus.cc:2454] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c58430115f4a24bd76c63933534a65 in term 1.
I20260923 14:43:21.462432 31947 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c58430115f4a24bd76c63933534a65, 4b5efe21879048469a41537fb3878dea; no voters:
I20260923 14:43:21.462637 32209 raft_consensus.cc:2781] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:21.462868 32209 raft_consensus.cc:686] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 1 LEADER]: Becoming Leader. State: Replica: 21c58430115f4a24bd76c63933534a65, State: Running, Role: LEADER
I20260923 14:43:21.463212 32209 consensus_queue.cc:237] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.466291 31731 catalog_manager.cc:5495] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c58430115f4a24bd76c63933534a65 (127.17.4.130). New cstate: current_term: 1 leader_uuid: "21c58430115f4a24bd76c63933534a65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } health_report { overall_health: UNKNOWN } } }
I20260923 14:43:21.500315 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.496999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40414 (local address 127.17.4.130:39223)
0923 14:43:21.497129 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:21.497132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:21.497146 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:43:21.497282 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:21.497285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:21.497342 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:21.497431 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:43:21.497635 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.498133 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.498900 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:21.499102 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:21.499174 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:21.499435 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:43:21.499907 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:43:21.499995 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:21.500062 (+ 67us) server_negotiation.cc:299] Negotiation successful
0923 14:43:21.500110 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:43:21.506356 32146 raft_consensus.cc:1261] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Refusing update from remote peer 21c58430115f4a24bd76c63933534a65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:21.506352 31874 raft_consensus.cc:1261] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Refusing update from remote peer 21c58430115f4a24bd76c63933534a65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:21.507040 32209 consensus_queue.cc:1035] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:21.507297 32212 consensus_queue.cc:1035] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:21.512976 32214 mvcc.cc:205] Tried to move back new op lower bound from 7332555167762251776 to 7332555167596113920. Current Snapshot: MvccSnapshot[applied={T|T < 7332555167762251776}]
I20260923 14:43:21.513972 32215 mvcc.cc:205] Tried to move back new op lower bound from 7332555167762251776 to 7332555167596113920. Current Snapshot: MvccSnapshot[applied={T|T < 7332555167762251776}]
I20260923 14:43:21.516659 32216 mvcc.cc:205] Tried to move back new op lower bound from 7332555167762251776 to 7332555167596113920. Current Snapshot: MvccSnapshot[applied={T|T < 7332555167762251776}]
I20260923 14:43:21.522606 31730 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:21.522783 31730 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:21.525271 31730 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Sending DeleteTablet for 3 replicas of tablet 46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:21.525938 31993 tablet_service.cc:1514] Processing DeleteTablet for tablet 46bf4db557a240f2ac889c1d3f8e80b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:21 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:40398
I20260923 14:43:21.526260 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31769
I20260923 14:43:21.526193 32125 tablet_service.cc:1514] Processing DeleteTablet for tablet 46bf4db557a240f2ac889c1d3f8e80b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:21 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:45444
I20260923 14:43:21.526355 31854 tablet_service.cc:1514] Processing DeleteTablet for tablet 46bf4db557a240f2ac889c1d3f8e80b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:21 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:48914
I20260923 14:43:21.527479 32225 tablet_replica.cc:330] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: stopping tablet replica
I20260923 14:43:21.527869 32225 raft_consensus.cc:2229] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:43:21.528204 32225 raft_consensus.cc:2258] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:21.528716 32224 tablet_replica.cc:330] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: stopping tablet replica
I20260923 14:43:21.529043 32224 raft_consensus.cc:2229] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:43:21.529403 32224 raft_consensus.cc:2258] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:21.531036 32225 ts_tablet_manager.cc:1905] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:21.532164 32224 ts_tablet_manager.cc:1905] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 14:43:21.533725 31717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:34655 (error 108)
I20260923 14:43:21.533999 32225 ts_tablet_manager.cc:1918] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:21.534113 32225 log.cc:1196] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:21.534453 32225 ts_tablet_manager.cc:1939] T 46bf4db557a240f2ac889c1d3f8e80b6 P b416ce7a517447d09b664f310a5ce927: Deleting consensus metadata
I20260923 14:43:21.534879 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31924
I20260923 14:43:21.536859 31715 catalog_manager.cc:4841] TS b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): tablet 46bf4db557a240f2ac889c1d3f8e80b6 (table test-table [id=365b7f9e2d834b0a95e13a4d1ed9bbca]) successfully deleted
I20260923 14:43:21.536988 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.536687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34655 (local address 127.0.0.1:48928)
0923 14:43:21.536831 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.536905 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:34655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260923 14:43:21.537185 31717 catalog_manager.cc:4584] TS 4b5efe21879048469a41537fb3878dea (127.17.4.129:34655): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 46bf4db557a240f2ac889c1d3f8e80b6: Network error: Client connection negotiation failed: client connection to 127.17.4.129:34655: connect: Connection refused (error 111)
I20260923 14:43:21.540644 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 32062
I20260923 14:43:21.541951 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.541570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39223 (local address 127.0.0.1:40424)
0923 14:43:21.541776 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.541849 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.130:39223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260923 14:43:21.546443 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 31698
I20260923 14:43:21.553121 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44477
--webserver_interface=127.17.4.190
--webserver_port=39797
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:21.667742 32227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:21.668083 32227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:21.668154 32227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:21.672120 32227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:21.672195 32227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:21.672232 32227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:21.672289 32227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:21.672328 32227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:21.677587 32227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=39797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:21.679028 32227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:21.680199 32227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:21.688668 32235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.688663 32233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.688668 32232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:21.689111 32227 server_base.cc:1034] running on GCE node
I20260923 14:43:21.689687 32227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:21.690845 32227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:21.692029 32227 hybrid_clock.cc:648] HybridClock initialized: now 1790174601692006 us; error 36 us; skew 500 ppm
Sep 23 14:43:21 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:21.694736 32227 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:21.695626 32227 webserver.cc:460] Webserver started at http://127.17.4.190:39797/ using document root <none> and password file <none>
I20260923 14:43:21.696255 32227 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:21.696350 32227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:21.700343 32227 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:43:21.702811 32242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.704101 32227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:43:21.704254 32227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "157803083f0d4f4795c1acc12ee1ae09"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "b6c36f36a2313cb4fe6d88a4f9d8667e"
server_key_iv: "6d759e29ff37802a4ae6063c0e52c45b"
server_key_version: "encryptionkey@0"
I20260923 14:43:21.704838 32227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:21.718106 32227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:21.721105 32227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:21.721328 32227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:21.728071 32227 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44477
I20260923 14:43:21.728094 32295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44477 every 8 connection(s)
I20260923 14:43:21.729207 32227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:21.729787 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 32227
I20260923 14:43:21.730207 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:34655
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:44477
--webserver_port=40081
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:21.734179 32296 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:43:21.735826 32296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap starting.
I20260923 14:43:21.753448 32296 log.cc:824] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:21.764444 32296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:43:21.764838 32296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09: Bootstrap complete.
I20260923 14:43:21.769099 32296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:21.769487 32296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 157803083f0d4f4795c1acc12ee1ae09, State: Initialized, Role: FOLLOWER
I20260923 14:43:21.769963 32296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:21.770077 32296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:21.770160 32296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:21.770282 32296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 2 FOLLOWER]: Advancing to term 3
I20260923 14:43:21.772311 32296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:21.772658 32296 leader_election.cc:302] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 157803083f0d4f4795c1acc12ee1ae09; no voters:
I20260923 14:43:21.772985 32296 leader_election.cc:288] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 14:43:21.773077 32300 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 14:43:21.773296 32300 raft_consensus.cc:686] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [term 3 LEADER]: Becoming Leader. State: Replica: 157803083f0d4f4795c1acc12ee1ae09, State: Running, Role: LEADER
I20260923 14:43:21.773588 32300 consensus_queue.cc:237] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } }
I20260923 14:43:21.774211 32296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:21.774938 32301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "157803083f0d4f4795c1acc12ee1ae09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } } }
I20260923 14:43:21.775060 32301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:21.775668 32302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 157803083f0d4f4795c1acc12ee1ae09. Latest consensus state: current_term: 3 leader_uuid: "157803083f0d4f4795c1acc12ee1ae09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157803083f0d4f4795c1acc12ee1ae09" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44477 } } }
I20260923 14:43:21.775842 32302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157803083f0d4f4795c1acc12ee1ae09 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:21.776129 32308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:21.781318 32308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:21.781937 32308 catalog_manager.cc:1259] Loaded cluster ID: f2e84247c0824a079188073ac3ebb201
I20260923 14:43:21.781998 32308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260923 14:43:21.783434 32308 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f72a704c9ad google::LogMessage::Fail() at ??:0
@ 0x7f72a704f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f72a704c4de google::LogMessage::Flush() at ??:0
@ 0x7f72a704da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f72b198bfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f72b198cd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f72b1989579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f72b19cd640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f72a929e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f72a929ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f72a92a03f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f72a928f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f72aa8d36db start_thread at ??:0
@ 0x7f72a5b4a61f clone at ??:0
W20260923 14:43:21.870261 32298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:21.870512 32298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:21.870553 32298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:21.874614 32298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:21.874670 32298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:21.874728 32298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:43:21.880050 32298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:34655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=40081
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:21.881078 32298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:21.882076 32298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:21.891937 32337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.892145 32338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:21.891927 32340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:21.892344 32298 server_base.cc:1034] running on GCE node
I20260923 14:43:21.892791 32298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:21.893484 32298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:21.894667 32298 hybrid_clock.cc:648] HybridClock initialized: now 1790174601894640 us; error 50 us; skew 500 ppm
Sep 23 14:43:21 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:21.897605 32298 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:43:21.898495 32298 webserver.cc:460] Webserver started at http://127.17.4.129:40081/ using document root <none> and password file <none>
I20260923 14:43:21.899061 32298 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:21.899158 32298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:21.903050 32298 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:21.905292 32347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:21.906601 32298 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:43:21.906736 32298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "4b5efe21879048469a41537fb3878dea"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "33740fd47d74a1a48b9b6adb99b794e0"
server_key_iv: "df2bb556a935a506a587f23a3fcc4a29"
server_key_version: "encryptionkey@0"
I20260923 14:43:21.907321 32298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:21.936118 32298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:21.939352 32298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:21.939554 32298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:21.940219 32298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:21.941395 32354 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 14:43:21.946677 32298 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 14:43:21.946760 32298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260923 14:43:21.946847 32298 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 14:43:21.948592 32298 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 14:43:21.948659 32298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260923 14:43:21.948937 32354 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Bootstrap starting.
I20260923 14:43:21.959326 32298 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:34655
I20260923 14:43:21.959537 32461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:34655 every 8 connection(s)
I20260923 14:43:21.960405 32298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:43:21.968110 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 32298
I20260923 14:43:21.968521 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:39223
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:44477
--webserver_port=43311
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:21.970978 32354 log.cc:824] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:21.980108 32354 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:43:21.980515 32354 tablet_bootstrap.cc:492] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Bootstrap complete.
I20260923 14:43:21.981952 32354 ts_tablet_manager.cc:1397] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Time spent bootstrapping tablet: real 0.033s user 0.026s sys 0.005s
I20260923 14:43:21.985092 32354 raft_consensus.cc:348] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.985631 32354 raft_consensus.cc:729] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5efe21879048469a41537fb3878dea, State: Initialized, Role: FOLLOWER
I20260923 14:43:21.986153 32354 consensus_queue.cc:260] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:21.987219 32354 ts_tablet_manager.cc:1428] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
W20260923 14:43:21.996306 32464 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:43:21.962330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:50473)
0923 14:43:21.962814 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.962865 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:21.963658 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:21.995539 (+ 31881us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":141,"threads_started":1}
W20260923 14:43:21.996781 32462 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44477 (0 consecutive failures): Network error: Failed to ping master at 127.17.4.190:44477: Client connection negotiation failed: client connection to 127.17.4.190:44477: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 14:43:21.997504 32464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.997266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:60369)
0923 14:43:21.997395 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.997453 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260923 14:43:21.998209 32464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:21.997991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:60029)
0923 14:43:21.998080 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:21.998147 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260923 14:43:21.998456 32462 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 14:43:22.083349 32465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:22.083653 32465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:22.083736 32465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:22.087715 32465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:22.087832 32465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:22.087927 32465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:43:22.093142 32465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:39223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=43311
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:22.094235 32465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:22.095261 32465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:22.105120 32472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:22.105175 32475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:22.105121 32473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:22.106384 32465 server_base.cc:1034] running on GCE node
I20260923 14:43:22.106968 32465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:22.107726 32465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:22.108938 32465 hybrid_clock.cc:648] HybridClock initialized: now 1790174602108904 us; error 45 us; skew 500 ppm
Sep 23 14:43:22 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174602, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:22.111868 32465 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:43:22.112650 32465 webserver.cc:460] Webserver started at http://127.17.4.130:43311/ using document root <none> and password file <none>
I20260923 14:43:22.113154 32465 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:22.113214 32465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:22.117049 32465 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:43:22.119127 32482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:22.120416 32465 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:22.120551 32465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "21c58430115f4a24bd76c63933534a65"
format_stamp: "Formatted at 2026-09-23 14:43:19 on dist-test-slave-54kg"
server_key: "1a66585235679e25ccfb7daff74ded8a"
server_key_iv: "a1d8ee6b4ce1a3b887a0157f7945aa38"
server_key_version: "encryptionkey@0"
I20260923 14:43:22.121096 32465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:22.141870 32465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:22.145263 32465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:22.145471 32465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:22.146087 32465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:22.147184 32489 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260923 14:43:22.151037 32489 ts_tablet_manager.cc:1852] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260923 14:43:22.151456 32489 ts_tablet_manager.cc:1905] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:22.155467 32489 ts_tablet_manager.cc:1918] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:22.155586 32489 log.cc:1196] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:22.156005 32489 ts_tablet_manager.cc:1939] T 46bf4db557a240f2ac889c1d3f8e80b6 P 21c58430115f4a24bd76c63933534a65: Deleting consensus metadata
I20260923 14:43:22.156337 32465 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260923 14:43:22.156410 32465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.009s user 0.000s sys 0.000s
I20260923 14:43:22.156519 32465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:22.156561 32465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:22.165478 32465 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39223
I20260923 14:43:22.165508 32598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39223 every 8 connection(s)
I20260923 14:43:22.166327 32465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:43:22.169685 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.168480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:45599)
0923 14:43:22.168917 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.169020 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
W20260923 14:43:22.170130 32599 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44477 (0 consecutive failures): Network error: Failed to ping master at 127.17.4.190:44477: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
I20260923 14:43:22.170747 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.170522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:54307)
0923 14:43:22.170645 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.170696 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 14:43:22.171342 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.171128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:43835)
0923 14:43:22.171246 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.171288 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260923 14:43:22.171512 32599 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 14:43:22.175673 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 32465
I20260923 14:43:22.176090 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:45329
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:44477
--webserver_port=36807
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:33031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:22.288738 32602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:22.289003 32602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:22.289048 32602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:22.293123 32602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:22.293182 32602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:22.293243 32602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:43:22.298540 32602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:45329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=36807
--tserver_master_addrs=127.17.4.190:44477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:22.299587 32602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:22.300616 32602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:22.309984 32608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:22.310020 32610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:22.310045 32607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:22.310446 32602 server_base.cc:1034] running on GCE node
I20260923 14:43:22.310880 32602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:22.311496 32602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:22.312682 32602 hybrid_clock.cc:648] HybridClock initialized: now 1790174602312645 us; error 55 us; skew 500 ppm
Sep 23 14:43:22 dist-test-slave-54kg krb5kdc[31149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174602, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:22.315412 32602 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:43:22.316362 32602 webserver.cc:460] Webserver started at http://127.17.4.131:36807/ using document root <none> and password file <none>
I20260923 14:43:22.316931 32602 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:22.317020 32602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:22.320722 32602 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:43:22.322741 32617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:22.323999 32602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:43:22.324170 32602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b416ce7a517447d09b664f310a5ce927"
format_stamp: "Formatted at 2026-09-23 14:43:20 on dist-test-slave-54kg"
server_key: "964181e91aeaef21910c503bcaa4d86a"
server_key_iv: "9b1bdce0ffd5d4da5cd368af5077290b"
server_key_version: "encryptionkey@0"
I20260923 14:43:22.324723 32602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:22.350106 32602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:22.353699 32602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:22.353897 32602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:22.354498 32602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:22.355309 32602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:22.355377 32602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:22.355449 32602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:22.355492 32602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:22.364533 32602 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:45329
I20260923 14:43:22.364559 32731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:45329 every 8 connection(s)
I20260923 14:43:22.365504 32602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:43:22.368808 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.367533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:43583)
0923 14:43:22.367999 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.368106 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":115,"threads_started":1}
W20260923 14:43:22.369292 32732 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44477 (0 consecutive failures): Network error: Failed to ping master at 127.17.4.190:44477: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
I20260923 14:43:22.369830 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.369628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:40439)
0923 14:43:22.369735 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.369780 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260923 14:43:22.370397 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.370217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:34589)
0923 14:43:22.370313 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.370353 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260923 14:43:22.370579 32732 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 14:43:22.372587 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 32602
I20260923 14:43:22.999514 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:22.999080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:60993)
0923 14:43:22.999339 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:22.999397 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":80,"threads_started":1}
I20260923 14:43:23.172497 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:23.172072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:58759)
0923 14:43:23.172349 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:23.172409 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":71,"threads_started":1}
I20260923 14:43:23.371542 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:23.371129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:57409)
0923 14:43:23.371389 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:23.371444 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":70,"threads_started":1}
I20260923 14:43:23.420645 32739 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:23.420989 32739 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:23.422101 32739 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223), b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
Sep 23 14:43:23 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.130@KRBTEST.COM
Sep 23 14:43:23 dist-test-slave-54kg krb5kdc[31149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174601, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.131@KRBTEST.COM
I20260923 14:43:23.442626 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:23.422399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39223 (local address 127.17.4.129:53649)
0923 14:43:23.422524 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:23.422541 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:23.422651 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:23.424634 (+ 1983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:23.424640 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:23.425222 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:23.425708 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:23.425722 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.427223 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.427228 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:23.428270 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:23.428280 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.429088 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.429091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:23.429327 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:23.435802 (+ 6475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:23.435823 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:23.437993 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:23.440201 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:23.440207 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:23.440220 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:23.440488 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:23.440859 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:23.440862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:23.440864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:23.441008 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:23.441646 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:23.441653 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:23.441887 (+ 234us) client_negotiation.cc:769] Sending connection context
0923 14:43:23.442075 (+ 188us) client_negotiation.cc:240] Negotiation successful
0923 14:43:23.442434 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":202,"spinlock_wait_cycles":6656}
I20260923 14:43:23.442633 32740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:23.422499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53649 (local address 127.17.4.130:39223)
0923 14:43:23.422944 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:23.422958 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:23.422994 (+ 36us) server_negotiation.cc:407] Connection header received
0923 14:43:23.423900 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:23.423908 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:23.424275 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:23.424590 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:23.425915 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.427061 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.428391 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.428957 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.429149 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:23.438264 (+ 9115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:23.438270 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:23.438282 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:23.438312 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:23.440074 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:23.440613 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:23.440618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:23.440623 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:23.440756 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:23.441105 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:23.441110 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:23.441112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:23.441518 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:23.441671 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:23.442184 (+ 513us) server_negotiation.cc:299] Negotiation successful
0923 14:43:23.442438 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":57,"threads_started":1}
I20260923 14:43:23.442644 32742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:23.422825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53345 (local address 127.17.4.131:45329)
0923 14:43:23.423234 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:23.423252 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:23.423281 (+ 29us) server_negotiation.cc:407] Connection header received
0923 14:43:23.423980 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:23.423987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:23.424278 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:23.424579 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:23.425878 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.427057 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.428387 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.428941 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.429149 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:23.438464 (+ 9315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:23.438469 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:23.438480 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:23.438509 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:23.440375 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:23.440841 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:23.440847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:23.440852 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:23.440971 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:23.441267 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:23.441270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:23.441272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:23.441639 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:23.441777 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:23.442185 (+ 408us) server_negotiation.cc:299] Negotiation successful
0923 14:43:23.442464 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":81,"threads_started":1}
I20260923 14:43:23.443202 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:23.422679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45329 (local address 127.17.4.129:53345)
0923 14:43:23.422963 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:23.422977 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:23.423083 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:23.424633 (+ 1550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:23.424638 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:23.425222 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:23.425707 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:23.425722 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.427228 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.427231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:23.428269 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:23.428280 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:23.429108 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:23.429114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:23.429319 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:23.435706 (+ 6387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:23.435723 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:23.438247 (+ 2524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:23.440519 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:23.440522 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:23.440524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:23.440726 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:23.441075 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:23.441080 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:23.441082 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:23.441169 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:23.441749 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:23.441752 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:23.441893 (+ 141us) client_negotiation.cc:769] Sending connection context
0923 14:43:23.442076 (+ 183us) client_negotiation.cc:240] Negotiation successful
0923 14:43:23.442517 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":228,"spinlock_wait_cycles":49280,"thread_start_us":94,"threads_started":1}
W20260923 14:43:23.445284 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
W20260923 14:43:23.445560 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:23.445631 32348 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5efe21879048469a41537fb3878dea; no voters: 21c58430115f4a24bd76c63933534a65, b416ce7a517447d09b664f310a5ce927
I20260923 14:43:23.445854 32739 raft_consensus.cc:2726] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:43:24.000679 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:24.000294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:57507)
0923 14:43:24.000529 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:24.000581 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260923 14:43:24.173589 32744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:24.173224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:46207)
0923 14:43:24.173443 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:24.173493 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260923 14:43:24.372617 32745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:24.372242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:60969)
0923 14:43:24.372464 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:24.372516 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260923 14:43:25.001767 32746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:25.001378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:58711)
0923 14:43:25.001620 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:25.001673 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":77,"threads_started":1}
I20260923 14:43:25.174806 32747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:25.174423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:57347)
0923 14:43:25.174659 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:25.174722 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":75,"threads_started":1}
I20260923 14:43:25.373760 32748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:25.373357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:46499)
0923 14:43:25.373597 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:25.373650 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":72,"threads_started":1}
I20260923 14:43:25.648885 32749 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:25.649008 32749 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:25.649564 32749 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223), b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
W20260923 14:43:25.650380 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
W20260923 14:43:25.650540 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:25.650590 32348 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5efe21879048469a41537fb3878dea; no voters: 21c58430115f4a24bd76c63933534a65, b416ce7a517447d09b664f310a5ce927
I20260923 14:43:25.650746 32749 raft_consensus.cc:2726] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:43:26.002955 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:26.002531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:53349)
0923 14:43:26.002794 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:26.002854 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":77,"threads_started":1}
I20260923 14:43:26.175937 32751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:26.175496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:45489)
0923 14:43:26.175746 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:26.175848 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":89,"threads_started":1}
I20260923 14:43:26.374938 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:26.374555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:60171)
0923 14:43:26.374801 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:26.374854 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":87,"threads_started":1}
I20260923 14:43:27.004369 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:27.003928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:60169)
0923 14:43:27.004216 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:27.004270 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":70,"threads_started":1}
I20260923 14:43:27.176992 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:27.176624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:45229)
0923 14:43:27.176849 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:27.176898 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":69,"threads_started":1}
I20260923 14:43:27.376211 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:27.375831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:44011)
0923 14:43:27.376066 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:27.376122 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":68,"threads_started":1}
I20260923 14:43:28.005504 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:28.005107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:55739)
0923 14:43:28.005356 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:28.005408 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":74,"threads_started":1}
I20260923 14:43:28.178041 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:28.177649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:36151)
0923 14:43:28.177895 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:28.177947 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":88,"threads_started":1}
I20260923 14:43:28.377327 32758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:28.376920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:33003)
0923 14:43:28.377182 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:28.377238 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":101,"threads_started":1}
I20260923 14:43:28.690132 32759 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:28.690317 32759 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:28.690819 32759 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223), b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
W20260923 14:43:28.691636 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
W20260923 14:43:28.691797 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:28.691861 32348 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5efe21879048469a41537fb3878dea; no voters: 21c58430115f4a24bd76c63933534a65, b416ce7a517447d09b664f310a5ce927
I20260923 14:43:28.692016 32759 raft_consensus.cc:2726] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:43:29.006872 32760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:29.006373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:56585)
0923 14:43:29.006699 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:29.006764 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":91,"threads_started":1}
I20260923 14:43:29.179225 32761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:29.178754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:50301)
0923 14:43:29.179063 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:29.179120 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":89,"threads_started":1}
I20260923 14:43:29.378515 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:29.378074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:43421)
0923 14:43:29.378366 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:29.378424 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":76,"threads_started":1}
I20260923 14:43:30.008337 32763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:30.007880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:41083)
0923 14:43:30.008154 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:30.008230 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":88,"threads_started":1}
I20260923 14:43:30.180500 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:30.180098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:44757)
0923 14:43:30.180349 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:30.180405 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260923 14:43:30.379714 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:30.379274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:35491)
0923 14:43:30.379566 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:30.379620 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":109,"threads_started":1}
I20260923 14:43:31.009606 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:31.009147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:37189)
0923 14:43:31.009441 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:31.009502 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":94,"threads_started":1}
I20260923 14:43:31.181663 32767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:31.181258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:59687)
0923 14:43:31.181512 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:31.181567 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":91,"threads_started":1}
I20260923 14:43:31.380884 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:31.380470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:42945)
0923 14:43:31.380733 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:31.380787 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":92,"threads_started":1}
I20260923 14:43:32.011294 301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:32.010706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:48593)
0923 14:43:32.011080 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:32.011158 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":112,"threads_started":1}
I20260923 14:43:32.182935 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:32.182461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:53869)
0923 14:43:32.182768 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:32.182831 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":99,"threads_started":1}
I20260923 14:43:32.355901 303 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:32.356058 303 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:32.356519 303 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223), b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
W20260923 14:43:32.357355 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
W20260923 14:43:32.357499 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:32.357549 32348 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5efe21879048469a41537fb3878dea; no voters: 21c58430115f4a24bd76c63933534a65, b416ce7a517447d09b664f310a5ce927
I20260923 14:43:32.357684 303 raft_consensus.cc:2726] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:43:32.381978 304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:32.381596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:54429)
0923 14:43:32.381833 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:32.381888 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":74,"threads_started":1}
I20260923 14:43:33.012497 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:33.012095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:60475)
0923 14:43:33.012338 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:33.012395 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":75,"threads_started":1}
I20260923 14:43:33.184291 306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:33.183751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:60619)
0923 14:43:33.184076 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:33.184171 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":74,"threads_started":1}
I20260923 14:43:33.383186 307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:33.382778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:35633)
0923 14:43:33.383033 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:33.383090 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
I20260923 14:43:34.013700 308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:34.013274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:39211)
0923 14:43:34.013531 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:34.013589 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":82,"threads_started":1}
I20260923 14:43:34.185442 309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:34.185026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:43997)
0923 14:43:34.185286 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:34.185343 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":90,"threads_started":1}
I20260923 14:43:34.384454 310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:34.383996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:35893)
0923 14:43:34.384294 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:34.384356 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":95,"threads_started":1}
I20260923 14:43:35.014998 311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:35.014522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:59445)
0923 14:43:35.014829 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:35.014892 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":84,"threads_started":1}
I20260923 14:43:35.186839 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:35.186334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:49347)
0923 14:43:35.186668 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:35.186737 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":111,"threads_started":1}
I20260923 14:43:35.385802 313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:35.385323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:55345)
0923 14:43:35.385622 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:35.385701 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":99,"threads_started":1}
I20260923 14:43:36.016574 314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:36.016081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:56891)
0923 14:43:36.016384 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:36.016468 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":94,"threads_started":1}
I20260923 14:43:36.188243 315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:36.187706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:39945)
0923 14:43:36.188070 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:36.188133 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":176,"threads_started":1}
I20260923 14:43:36.387107 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:36.386692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:45427)
0923 14:43:36.386952 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:36.387011 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":79,"threads_started":1}
I20260923 14:43:36.871033 317 raft_consensus.cc:482] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:36.871166 317 raft_consensus.cc:504] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c58430115f4a24bd76c63933534a65" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39223 } } peers { permanent_uuid: "b416ce7a517447d09b664f310a5ce927" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45329 } } peers { permanent_uuid: "4b5efe21879048469a41537fb3878dea" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34655 } }
I20260923 14:43:36.871532 317 leader_election.cc:288] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223), b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329)
W20260923 14:43:36.872500 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 21c58430115f4a24bd76c63933534a65 (127.17.4.130:39223): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
W20260923 14:43:36.872694 32348 leader_election.cc:341] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b416ce7a517447d09b664f310a5ce927 (127.17.4.131:45329): Not found: Tablet not found: 46bf4db557a240f2ac889c1d3f8e80b6
I20260923 14:43:36.872763 32348 leader_election.cc:302] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5efe21879048469a41537fb3878dea; no voters: 21c58430115f4a24bd76c63933534a65, b416ce7a517447d09b664f310a5ce927
I20260923 14:43:36.872907 317 raft_consensus.cc:2726] T 46bf4db557a240f2ac889c1d3f8e80b6 P 4b5efe21879048469a41537fb3878dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:43:37.018127 318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:37.017656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.129:42581)
0923 14:43:37.017956 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:37.018021 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":74,"threads_started":1}
I20260923 14:43:37.189550 319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:37.189159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.130:40401)
0923 14:43:37.189398 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:37.189454 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":71,"threads_started":1}
I20260923 14:43:37.380846 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 32298
I20260923 14:43:37.387111 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 32465
I20260923 14:43:37.389060 320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:37.388479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44477 (local address 127.17.4.131:44657)
0923 14:43:37.388836 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:37.388909 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":80,"threads_started":1}
I20260923 14:43:37.393105 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 32602
2026-09-23T14:43:37Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19292 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:43:37 dist-test-slave-54kg krb5kdc[323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:43:37 dist-test-slave-54kg krb5kdc[323](info): set up 2 sockets
Sep 23 14:43:37 dist-test-slave-54kg krb5kdc[323](info): commencing operation
krb5kdc: starting...
W20260923 14:43:38.437122 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:43:38 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:43:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:43:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:43:38.563261 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44699
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:38.676646 336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:38.676983 336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:38.677058 336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:38.681277 336 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 14:43:38.681375 336 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 14:43:38.681402 336 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 14:43:38.681427 336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:38.681501 336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:38.681562 336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:38.681602 336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:38.681638 336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:38.687440 336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:38.688715 336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:38.689796 336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:43:38.699247 336 server_base.cc:1034] running on GCE node
W20260923 14:43:38.699179 341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:38.699200 344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:38.699132 342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:38.700196 336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:38.701398 336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:38.702571 336 hybrid_clock.cc:648] HybridClock initialized: now 1790174618702547 us; error 38 us; skew 500 ppm
Sep 23 14:43:38 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:38.705856 336 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:38.706861 336 webserver.cc:460] Webserver started at http://127.17.4.190:37273/ using document root <none> and password file <none>
I20260923 14:43:38.707461 336 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:38.707525 336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:38.707805 336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:38.709964 336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "3c9cced63f284c0ab82d0d6a10c7a149"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "640723de0e27264a4f0725cac6ce26f7"
server_key_iv: "219638d91768a839af685ac20b42c3e7"
server_key_version: "encryptionkey@0"
I20260923 14:43:38.710546 336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "3c9cced63f284c0ab82d0d6a10c7a149"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "640723de0e27264a4f0725cac6ce26f7"
server_key_iv: "219638d91768a839af685ac20b42c3e7"
server_key_version: "encryptionkey@0"
I20260923 14:43:38.714381 336 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 14:43:38.716851 351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:38.718091 336 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:43:38.718242 336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "3c9cced63f284c0ab82d0d6a10c7a149"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "640723de0e27264a4f0725cac6ce26f7"
server_key_iv: "219638d91768a839af685ac20b42c3e7"
server_key_version: "encryptionkey@0"
I20260923 14:43:38.718357 336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:38.742537 336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:38.746033 336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:38.746249 336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:38.753356 336 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44699
I20260923 14:43:38.753659 404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44699 every 8 connection(s)
I20260923 14:43:38.754362 336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:38.757128 405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:38.760066 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 336
I20260923 14:43:38.760211 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:43:38.760502 17426 external_mini_cluster.cc:1428] Setting key 4e2d09f4240d0c60652d0fe0ece40cdd
I20260923 14:43:38.763309 405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap starting.
I20260923 14:43:38.766005 405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:38.766804 405 log.cc:824] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:38.768891 405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: No bootstrap required, opened a new log
Sep 23 14:43:38 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:38.773016 405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:38.773324 405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:38.773401 405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9cced63f284c0ab82d0d6a10c7a149, State: Initialized, Role: FOLLOWER
I20260923 14:43:38.773882 405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:38.774035 405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:38.774099 405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:38.774196 405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:38.775417 405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:38.775810 405 leader_election.cc:302] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c9cced63f284c0ab82d0d6a10c7a149; no voters:
I20260923 14:43:38.776156 405 leader_election.cc:288] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:43:38.776278 410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:38.776515 410 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 LEADER]: Becoming Leader. State: Replica: 3c9cced63f284c0ab82d0d6a10c7a149, State: Running, Role: LEADER
I20260923 14:43:38.776595 408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:38.761965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.17.4.190:44699)
0923 14:43:38.762398 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:38.762418 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:38.762472 (+ 54us) server_negotiation.cc:407] Connection header received
0923 14:43:38.763274 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:38.763299 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:38.763730 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:38.764115 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:38.764820 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:38.766265 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:38.767203 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:38.767781 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:38.767962 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:38.770471 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:38.770477 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:38.770496 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:38.770530 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:38.773213 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:38.773748 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:38.773753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:38.773758 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:38.773873 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:38.774205 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:38.774211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:38.774213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:38.774749 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:38.774935 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:38.775203 (+ 268us) server_negotiation.cc:299] Negotiation successful
0923 14:43:38.775531 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":113,"threads_started":1}
I20260923 14:43:38.776868 410 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:38.777478 405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:38.778568 411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } } }
I20260923 14:43:38.778712 411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:38.779018 412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c9cced63f284c0ab82d0d6a10c7a149. Latest consensus state: current_term: 1 leader_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } } }
I20260923 14:43:38.779114 419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:38.779114 412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:38.782152 419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:38.788152 419 catalog_manager.cc:1347] Generated new cluster ID: a0189f75b646490fa59bfa657b19d8c0
I20260923 14:43:38.788228 419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:38.798930 419 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:43:38.799947 419 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:38.808502 419 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Generated new TSK 0
I20260923 14:43:38.809224 419 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:43:38.851459 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44699
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:38.964370 431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:38.964684 431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:38.964761 431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:38.968784 431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:38.968863 431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:38.968952 431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:43:38.974227 431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:38.975328 431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:38.976457 431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:38.986271 436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:38.986296 439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:38.986280 431 server_base.cc:1034] running on GCE node
W20260923 14:43:38.986320 437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:38.986948 431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:38.987659 431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:38.988847 431 hybrid_clock.cc:648] HybridClock initialized: now 1790174618988834 us; error 26 us; skew 500 ppm
Sep 23 14:43:38 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:38.991590 431 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:43:38.992545 431 webserver.cc:460] Webserver started at http://127.17.4.129:37967/ using document root <none> and password file <none>
I20260923 14:43:38.993135 431 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:38.993229 431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:38.993477 431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:38.995544 431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "09d8bab3da49466cae651c0cf7038071"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "450cbb3c7ed19c89467d3238a1c77d78"
server_key_iv: "197a5f18c644eabc07ef2753b9cbac6e"
server_key_version: "encryptionkey@0"
I20260923 14:43:38.996200 431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "09d8bab3da49466cae651c0cf7038071"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "450cbb3c7ed19c89467d3238a1c77d78"
server_key_iv: "197a5f18c644eabc07ef2753b9cbac6e"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.000031 431 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 14:43:39.002453 446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.003746 431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:39.003949 431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "09d8bab3da49466cae651c0cf7038071"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "450cbb3c7ed19c89467d3238a1c77d78"
server_key_iv: "197a5f18c644eabc07ef2753b9cbac6e"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.004072 431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:39.031234 431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:39.034545 431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:39.034792 431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:39.035422 431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:39.036393 431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:39.036468 431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.036542 431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:39.036597 431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.045832 431 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:37151
I20260923 14:43:39.045850 559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:37151 every 8 connection(s)
I20260923 14:43:39.046821 431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:43:39.048889 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 431
I20260923 14:43:39.049062 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:43:39.049357 17426 external_mini_cluster.cc:1428] Setting key 6f26911654fbb6a36c5718128bed5752
Sep 23 14:43:39 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:43:39.062280 408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.048923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:34979 (local address 127.17.4.190:44699)
0923 14:43:39.050892 (+ 1969us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.050908 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.050932 (+ 24us) server_negotiation.cc:407] Connection header received
0923 14:43:39.051785 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.051791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.051855 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.051956 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:39.053344 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.053903 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.055121 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.055362 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.055482 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.058158 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:39.058161 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:39.058163 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:39.058188 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:39.059862 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.060455 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.060461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.060463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.060550 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.060922 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.060926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.060928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.061131 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:39.061243 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.061881 (+ 638us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.062063 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1882}
I20260923 14:43:39.063088 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.049387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:34979)
0923 14:43:39.050531 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.050594 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.051523 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.052155 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.052163 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.052624 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:39.053164 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.053179 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.054056 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.054062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.054980 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.054990 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.055532 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.055536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.055718 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.056457 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:39.056474 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:39.057964 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:39.060031 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:39.060037 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:39.060056 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:39.060338 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:39.060653 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:39.060656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:39.060659 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:39.060823 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:39.061243 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:39.061251 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:39.061587 (+ 336us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.061825 (+ 238us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.062157 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"thread_start_us":643,"threads_started":1}
I20260923 14:43:39.064540 560 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44699
I20260923 14:43:39.064806 560 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:39.065327 560 heartbeater.cc:511] Master 127.17.4.190:44699 requested a full tablet report, sending...
I20260923 14:43:39.066999 368 ts_manager.cc:194] Registered new tserver with Master: 09d8bab3da49466cae651c0cf7038071 (127.17.4.129:37151)
I20260923 14:43:39.068197 368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:34979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:43:39.079216 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44699
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:39.195402 565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:39.195677 565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:39.195752 565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:39.200016 565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:39.200080 565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:39.200183 565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:43:39.205736 565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:39.206858 565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:39.208030 565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:39.218015 574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:39.218022 572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:39.218072 571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:39.218077 565 server_base.cc:1034] running on GCE node
I20260923 14:43:39.218782 565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:39.219452 565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:39.220613 565 hybrid_clock.cc:648] HybridClock initialized: now 1790174619220568 us; error 59 us; skew 500 ppm
Sep 23 14:43:39 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174619, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:39.223596 565 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:43:39.224686 565 webserver.cc:460] Webserver started at http://127.17.4.130:37371/ using document root <none> and password file <none>
I20260923 14:43:39.225303 565 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:39.225399 565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:39.225630 565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:39.227900 565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "04b1d4421a4a47e8ac764403962a113b"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "a96d06881f4e9f6d4f36857a911698e8"
server_key_iv: "65fc15253fc57d89fb690766abe65d7d"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.228526 565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "04b1d4421a4a47e8ac764403962a113b"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "a96d06881f4e9f6d4f36857a911698e8"
server_key_iv: "65fc15253fc57d89fb690766abe65d7d"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.232656 565 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 14:43:39.235181 581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.236613 565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:43:39.236747 565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "04b1d4421a4a47e8ac764403962a113b"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "a96d06881f4e9f6d4f36857a911698e8"
server_key_iv: "65fc15253fc57d89fb690766abe65d7d"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.236864 565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:39.277648 565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:39.281742 565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:39.281965 565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:39.282599 565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:39.283484 565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:39.283567 565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.283661 565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:39.283712 565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.292919 565 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39159
I20260923 14:43:39.292987 695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39159 every 8 connection(s)
I20260923 14:43:39.293953 565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:43:39.296459 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 565
I20260923 14:43:39.296569 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:43:39.296875 17426 external_mini_cluster.cc:1428] Setting key 83472ca23564b547651caf50bb3cb2c2
Sep 23 14:43:39 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174619, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:43:39.310781 408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.295968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:36507 (local address 127.17.4.190:44699)
0923 14:43:39.296129 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.296133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.297234 (+ 1101us) server_negotiation.cc:407] Connection header received
0923 14:43:39.298878 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.298882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.298948 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.299048 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:39.300428 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.300981 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.302235 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.302659 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.302784 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.305890 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:39.305894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:39.305897 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:39.305935 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:39.307888 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.308802 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.308809 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.308812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.308926 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.309359 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.309363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.309364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.309616 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:39.309781 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.310367 (+ 586us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.310524 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
I20260923 14:43:39.311841 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.296422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:36507)
0923 14:43:39.297025 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.297099 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.298650 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.299239 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.299247 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.299644 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:39.300274 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.300289 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.301127 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.301131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.302091 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.302102 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.302839 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.302842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.303032 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.303725 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:39.303743 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:39.305677 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:39.308044 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:39.308059 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:39.308080 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:39.308610 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:39.309043 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:39.309047 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:39.309049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:39.309240 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:39.309780 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:39.309790 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:39.310095 (+ 305us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.310309 (+ 214us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.310722 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":201,"threads_started":1}
I20260923 14:43:39.313194 696 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44699
I20260923 14:43:39.313474 696 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:39.314040 696 heartbeater.cc:511] Master 127.17.4.190:44699 requested a full tablet report, sending...
I20260923 14:43:39.315335 368 ts_manager.cc:194] Registered new tserver with Master: 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159)
I20260923 14:43:39.316321 368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:36507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:43:39.330382 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44699
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:39.445331 701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:39.445607 701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:39.445652 701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:39.449749 701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:39.449813 701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:39.449915 701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:43:39.455207 701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:39.456300 701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:39.457377 701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:39.467536 706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:39.467633 701 server_base.cc:1034] running on GCE node
W20260923 14:43:39.467574 707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:39.467564 709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:39.468253 701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:39.468986 701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:39.470170 701 hybrid_clock.cc:648] HybridClock initialized: now 1790174619470149 us; error 32 us; skew 500 ppm
Sep 23 14:43:39 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174619, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:39.473178 701 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:43:39.474143 701 webserver.cc:460] Webserver started at http://127.17.4.131:43265/ using document root <none> and password file <none>
I20260923 14:43:39.474697 701 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:39.474758 701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:39.474923 701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:43:39.477123 701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "b33ffbb338604fa085d9dd848c8eb22e"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "86a38267609f61661eeac223e41d5330"
server_key_iv: "486e0547d7d56f06f8887130f67ff1b8"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.477674 701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "b33ffbb338604fa085d9dd848c8eb22e"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "86a38267609f61661eeac223e41d5330"
server_key_iv: "486e0547d7d56f06f8887130f67ff1b8"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.481874 701 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 14:43:39.484355 716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.485635 701 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:43:39.485776 701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b33ffbb338604fa085d9dd848c8eb22e"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "86a38267609f61661eeac223e41d5330"
server_key_iv: "486e0547d7d56f06f8887130f67ff1b8"
server_key_version: "encryptionkey@0"
I20260923 14:43:39.485896 701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:39.498337 701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:39.501339 701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:39.501542 701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:39.502219 701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:43:39.503028 701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:43:39.503098 701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.503166 701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:43:39.503227 701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:39.512445 701 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:35557
I20260923 14:43:39.512475 830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:35557 every 8 connection(s)
I20260923 14:43:39.513334 701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:43:39.517252 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 701
I20260923 14:43:39.517390 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:43:39.517725 17426 external_mini_cluster.cc:1428] Setting key ac89a84d4ab54b4c34c0e809ce37791a
Sep 23 14:43:39 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174619, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:43:39.527629 408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.515096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:44595 (local address 127.17.4.190:44699)
0923 14:43:39.515242 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.515246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.516066 (+ 820us) server_negotiation.cc:407] Connection header received
0923 14:43:39.517751 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.517754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.517833 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.517920 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:39.519575 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.520329 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.521478 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.521711 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.521825 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.524518 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:39.524521 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:39.524523 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:39.524556 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:39.525821 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.526293 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.526296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.526297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.526370 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.526695 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.526697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.526698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.526866 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:39.526941 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.527406 (+ 465us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.527506 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:43:39.528510 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.515411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:44595)
0923 14:43:39.515910 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.515956 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.517492 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.518135 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.518143 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.518823 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:43:39.519429 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.519444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.520456 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.520458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.521357 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.521367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.521897 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.521903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.522097 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.522734 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:43:39.522752 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:43:39.524344 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:43:39.525927 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:39.525932 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:39.525944 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:39.526206 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:39.526447 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:43:39.526449 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:43:39.526451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:43:39.526614 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:43:39.526951 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:43:39.526956 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:43:39.527187 (+ 231us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.527348 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.527626 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":108,"threads_started":1}
I20260923 14:43:39.529685 831 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44699
I20260923 14:43:39.529908 831 heartbeater.cc:464] Registering TS with master...
I20260923 14:43:39.530387 831 heartbeater.cc:511] Master 127.17.4.190:44699 requested a full tablet report, sending...
I20260923 14:43:39.531519 368 ts_manager.cc:194] Registered new tserver with Master: b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
I20260923 14:43:39.532150 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:43:39.532326 368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:44595
I20260923 14:43:39.542022 408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.534384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60378 (local address 127.17.4.190:44699)
0923 14:43:39.534542 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.534547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.534690 (+ 143us) server_negotiation.cc:407] Connection header received
0923 14:43:39.534856 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.534860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.534907 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.534991 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:43:39.535723 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.536266 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.537125 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.537353 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.537464 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.538866 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:43:39.538869 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:43:39.538872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:43:39.538897 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:43:39.540276 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.540711 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.540716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.540719 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.540805 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:43:39.541087 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:43:39.541091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:43:39.541093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:43:39.541355 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:43:39.541496 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.541735 (+ 239us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.541856 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 14:43:39.545084 368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:43:39.548122 368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:43:39.562146 842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.556468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.0.0.1:56320)
0923 14:43:39.556839 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.556885 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.557003 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.557796 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.557802 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.557826 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:39.557986 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.557995 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.559330 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.559335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.560516 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.560526 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.561607 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.561612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.561720 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.561761 (+ 41us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.561873 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.561982 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":113,"threads_started":1}
I20260923 14:43:39.562184 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.556604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56320 (local address 127.17.4.130:39159)
0923 14:43:39.556920 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.556934 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.556956 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:43:39.557174 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.557186 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.557419 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.557587 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:39.558088 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.559209 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.560651 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.561476 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.561600 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.561755 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.561929 (+ 174us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.562026 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":133,"threads_started":1}
I20260923 14:43:39.562794 846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.557584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37151 (local address 127.0.0.1:55840)
0923 14:43:39.557913 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.557927 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.558017 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.558642 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.558646 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.558663 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:39.558767 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.558776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.560601 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.560606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.561365 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.561374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.562467 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.562470 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.562564 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.562588 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.562653 (+ 65us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.562706 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":105,"threads_started":1}
I20260923 14:43:39.563161 844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.557257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:35557 (local address 127.0.0.1:46040)
0923 14:43:39.557855 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.557868 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.557946 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.558837 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.558840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.558857 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:39.558949 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.558954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.560362 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.560365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.561518 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.561530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.562786 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.562789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.562887 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.562909 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.562978 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.563042 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":102,"threads_started":1}
I20260923 14:43:39.563861 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.558011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55840 (local address 127.17.4.129:37151)
0923 14:43:39.558253 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.558270 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.558297 (+ 27us) server_negotiation.cc:407] Connection header received
0923 14:43:39.558360 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.558364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.558498 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.558657 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:39.558867 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.560460 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.561496 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.562323 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.563080 (+ 757us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.563225 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.563276 (+ 51us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.563378 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":86,"threads_started":1}
I20260923 14:43:39.563910 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.557439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46040 (local address 127.17.4.131:35557)
0923 14:43:39.558260 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.558271 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.558294 (+ 23us) server_negotiation.cc:407] Connection header received
0923 14:43:39.558367 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.558372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.558552 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.558693 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:39.559074 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.560230 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.561650 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.562486 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.562592 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.562726 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.563658 (+ 932us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.563750 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":156,"threads_started":1}
I20260923 14:43:39.565402 629 tablet_service.cc:1467] Processing CreateTablet for tablet ef4c8c17421149a99dd1c670565713d7 (DEFAULT_TABLE table=test-table [id=7b971417ed7f4c2ca956d83d5acec947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:39.566354 629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef4c8c17421149a99dd1c670565713d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:39.566500 764 tablet_service.cc:1467] Processing CreateTablet for tablet ef4c8c17421149a99dd1c670565713d7 (DEFAULT_TABLE table=test-table [id=7b971417ed7f4c2ca956d83d5acec947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:39.566498 494 tablet_service.cc:1467] Processing CreateTablet for tablet ef4c8c17421149a99dd1c670565713d7 (DEFAULT_TABLE table=test-table [id=7b971417ed7f4c2ca956d83d5acec947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:43:39.567493 764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef4c8c17421149a99dd1c670565713d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:39.567487 494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef4c8c17421149a99dd1c670565713d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:43:39.572047 848 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Bootstrap starting.
I20260923 14:43:39.574661 848 tablet_bootstrap.cc:654] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:39.574811 849 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Bootstrap starting.
I20260923 14:43:39.575404 850 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Bootstrap starting.
I20260923 14:43:39.575901 848 log.cc:824] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:39.577592 850 tablet_bootstrap.cc:654] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:39.577991 849 tablet_bootstrap.cc:654] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Neither blocks nor log segments found. Creating new log.
I20260923 14:43:39.578218 848 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: No bootstrap required, opened a new log
I20260923 14:43:39.578511 848 ts_tablet_manager.cc:1397] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260923 14:43:39.578896 850 log.cc:824] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:39.578940 849 log.cc:824] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:39.580705 850 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: No bootstrap required, opened a new log
I20260923 14:43:39.580914 850 ts_tablet_manager.cc:1397] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:43:39.582095 849 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: No bootstrap required, opened a new log
I20260923 14:43:39.582278 849 ts_tablet_manager.cc:1397] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260923 14:43:39.582245 848 raft_consensus.cc:348] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.582587 848 raft_consensus.cc:374] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:39.582664 848 raft_consensus.cc:729] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04b1d4421a4a47e8ac764403962a113b, State: Initialized, Role: FOLLOWER
I20260923 14:43:39.583171 848 consensus_queue.cc:260] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.584360 848 ts_tablet_manager.cc:1428] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260923 14:43:39.584766 696 heartbeater.cc:503] Master 127.17.4.190:44699 was elected leader, sending a full tablet report...
I20260923 14:43:39.584647 850 raft_consensus.cc:348] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.584903 850 raft_consensus.cc:374] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:39.584950 850 raft_consensus.cc:729] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b33ffbb338604fa085d9dd848c8eb22e, State: Initialized, Role: FOLLOWER
I20260923 14:43:39.585381 850 consensus_queue.cc:260] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.586030 831 heartbeater.cc:503] Master 127.17.4.190:44699 was elected leader, sending a full tablet report...
I20260923 14:43:39.586328 850 ts_tablet_manager.cc:1428] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:43:39.587244 849 raft_consensus.cc:348] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.587469 849 raft_consensus.cc:374] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:43:39.587545 849 raft_consensus.cc:729] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d8bab3da49466cae651c0cf7038071, State: Initialized, Role: FOLLOWER
I20260923 14:43:39.588024 849 consensus_queue.cc:260] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.588750 560 heartbeater.cc:503] Master 127.17.4.190:44699 was elected leader, sending a full tablet report...
I20260923 14:43:39.589044 849 ts_tablet_manager.cc:1428] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Time spent starting tablet: real 0.007s user 0.001s sys 0.005s
I20260923 14:43:39.653425 856 raft_consensus.cc:482] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:43:39.653667 856 raft_consensus.cc:504] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.654891 856 leader_election.cc:288] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
I20260923 14:43:39.659499 843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.655275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:43515 (local address 127.17.4.130:39159)
0923 14:43:39.655423 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.655427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.655689 (+ 262us) server_negotiation.cc:407] Connection header received
0923 14:43:39.655761 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.655764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.655841 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.655954 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:39.656350 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.657170 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.658478 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.658916 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.659007 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.659085 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.659279 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.659358 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:43:39.659538 845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.655742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55503 (local address 127.17.4.131:35557)
0923 14:43:39.655899 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.655904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.656032 (+ 128us) server_negotiation.cc:407] Connection header received
0923 14:43:39.656133 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.656136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.656185 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.656247 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:43:39.656532 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.657238 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.658547 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.658939 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.659081 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.659143 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.659349 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.659431 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 14:43:39.659540 857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.655164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.17.4.129:43515)
0923 14:43:39.655487 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.655504 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.655631 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.655992 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.655998 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.656022 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:39.656207 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.656213 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.657290 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.657293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.658347 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.658357 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.659040 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.659044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.659136 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.659168 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.659240 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.659325 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":3,"thread_start_us":149,"threads_started":1}
I20260923 14:43:39.659554 858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.655618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:35557 (local address 127.17.4.129:55503)
0923 14:43:39.655931 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.655947 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:43:39.656047 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:43:39.656281 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:43:39.656285 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:43:39.656307 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:43:39.656428 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.656433 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.657398 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.657401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.658376 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:43:39.658388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.659090 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.659095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:43:39.659200 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.659218 (+ 18us) client_negotiation.cc:769] Sending connection context
0923 14:43:39.659315 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 14:43:39.659378 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":19,"thread_start_us":142,"threads_started":1}
I20260923 14:43:39.660274 649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef4c8c17421149a99dd1c670565713d7" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b1d4421a4a47e8ac764403962a113b" is_pre_election: true
I20260923 14:43:39.660537 784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef4c8c17421149a99dd1c670565713d7" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b33ffbb338604fa085d9dd848c8eb22e" is_pre_election: true
I20260923 14:43:39.660585 649 raft_consensus.cc:2454] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 0.
I20260923 14:43:39.660828 784 raft_consensus.cc:2454] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 0.
I20260923 14:43:39.661084 450 leader_election.cc:302] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04b1d4421a4a47e8ac764403962a113b, 09d8bab3da49466cae651c0cf7038071; no voters:
I20260923 14:43:39.661319 856 raft_consensus.cc:2781] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:43:39.661396 856 raft_consensus.cc:482] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:43:39.661432 856 raft_consensus.cc:3037] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:39.662480 856 raft_consensus.cc:504] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.663058 856 leader_election.cc:288] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 election: Requested vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
I20260923 14:43:39.663354 649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef4c8c17421149a99dd1c670565713d7" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b1d4421a4a47e8ac764403962a113b"
I20260923 14:43:39.663496 649 raft_consensus.cc:3037] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:39.663725 784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef4c8c17421149a99dd1c670565713d7" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b33ffbb338604fa085d9dd848c8eb22e"
I20260923 14:43:39.663890 784 raft_consensus.cc:3037] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:43:39.664685 649 raft_consensus.cc:2454] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 1.
I20260923 14:43:39.664937 784 raft_consensus.cc:2454] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 1.
I20260923 14:43:39.664974 450 leader_election.cc:302] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04b1d4421a4a47e8ac764403962a113b, 09d8bab3da49466cae651c0cf7038071; no voters:
I20260923 14:43:39.665141 856 raft_consensus.cc:2781] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:43:39.665421 856 raft_consensus.cc:686] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 LEADER]: Becoming Leader. State: Replica: 09d8bab3da49466cae651c0cf7038071, State: Running, Role: LEADER
I20260923 14:43:39.665779 856 consensus_queue.cc:237] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:43:39.668917 368 catalog_manager.cc:5495] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09d8bab3da49466cae651c0cf7038071 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "09d8bab3da49466cae651c0cf7038071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } health_report { overall_health: HEALTHY } } }
I20260923 14:43:39.690039 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.686432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55852 (local address 127.17.4.129:37151)
0923 14:43:39.686569 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 14:43:39.686573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:43:39.686587 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:43:39.686678 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:43:39.686681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:43:39.686734 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:43:39.686821 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:43:39.687092 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.687584 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.688510 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:43:39.688722 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:43:39.688839 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:43:39.689161 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:43:39.689628 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:43:39.689768 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 14:43:39.689834 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 14:43:39.689893 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:43:39.695920 784 raft_consensus.cc:1261] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Refusing update from remote peer 09d8bab3da49466cae651c0cf7038071: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:39.695923 649 raft_consensus.cc:1261] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Refusing update from remote peer 09d8bab3da49466cae651c0cf7038071: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:43:39.696667 856 consensus_queue.cc:1035] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:39.696853 859 consensus_queue.cc:1035] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:43:39.705081 864 mvcc.cc:205] Tried to move back new op lower bound from 7332555242266959872 to 7332555242153738240. Current Snapshot: MvccSnapshot[applied={T|T < 7332555242266959872}]
I20260923 14:43:39.713193 367 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:39.713376 367 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:43:39.715627 367 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Sending DeleteTablet for 3 replicas of tablet ef4c8c17421149a99dd1c670565713d7
I20260923 14:43:39.716432 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 431
I20260923 14:43:39.716500 629 tablet_service.cc:1514] Processing DeleteTablet for tablet ef4c8c17421149a99dd1c670565713d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:39 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:56320
I20260923 14:43:39.717125 764 tablet_service.cc:1514] Processing DeleteTablet for tablet ef4c8c17421149a99dd1c670565713d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:39 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:46040
I20260923 14:43:39.717618 872 tablet_replica.cc:330] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: stopping tablet replica
I20260923 14:43:39.717957 872 raft_consensus.cc:2229] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:43:39.718310 872 raft_consensus.cc:2258] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:39.718346 871 tablet_replica.cc:330] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: stopping tablet replica
I20260923 14:43:39.718611 871 raft_consensus.cc:2229] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:43:39.718897 871 raft_consensus.cc:2258] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:43:39.720264 871 ts_tablet_manager.cc:1905] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:39.720264 872 ts_tablet_manager.cc:1905] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:43:39.722975 871 ts_tablet_manager.cc:1918] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:39.723021 872 ts_tablet_manager.cc:1918] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:43:39.723075 871 log.cc:1196] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/ef4c8c17421149a99dd1c670565713d7
I20260923 14:43:39.723094 872 log.cc:1196] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/ef4c8c17421149a99dd1c670565713d7
W20260923 14:43:39.723312 355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:37151 (error 108)
I20260923 14:43:39.723425 871 ts_tablet_manager.cc:1939] T ef4c8c17421149a99dd1c670565713d7 P 04b1d4421a4a47e8ac764403962a113b: Deleting consensus metadata
I20260923 14:43:39.723435 872 ts_tablet_manager.cc:1939] T ef4c8c17421149a99dd1c670565713d7 P b33ffbb338604fa085d9dd848c8eb22e: Deleting consensus metadata
I20260923 14:43:39.724166 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 565
I20260923 14:43:39.724455 844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.724179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37151 (local address 127.0.0.1:55868)
0923 14:43:39.724305 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.724375 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260923 14:43:39.724767 355 catalog_manager.cc:4584] TS 09d8bab3da49466cae651c0cf7038071 (127.17.4.129:37151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ef4c8c17421149a99dd1c670565713d7: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37151: connect: Connection refused (error 111)
I20260923 14:43:39.725090 355 catalog_manager.cc:4841] TS b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557): tablet ef4c8c17421149a99dd1c670565713d7 (table test-table [id=7b971417ed7f4c2ca956d83d5acec947]) successfully deleted
I20260923 14:43:39.730214 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 701
I20260923 14:43:39.731330 844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:43:39.730449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.0.0.1:56328)
0923 14:43:39.731141 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0923 14:43:39.731222 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.130:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":586}
I20260923 14:43:39.738982 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 336
I20260923 14:43:59.746119 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44699
--webserver_interface=127.17.4.190
--webserver_port=37273
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:43:59.865456 874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:43:59.865689 874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:43:59.865798 874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:43:59.869731 874 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 14:43:59.869786 874 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 14:43:59.869802 874 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 14:43:59.869865 874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:43:59.869901 874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:43:59.869947 874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:43:59.870002 874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:43:59.870038 874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:43:59.875113 874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=37273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:43:59.876189 874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:43:59.877256 874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:43:59.890484 880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:43:59.890496 881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:59.890569 874 server_base.cc:1034] running on GCE node
W20260923 14:43:59.890518 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:43:59.891515 874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:43:59.893028 874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:43:59.894187 874 hybrid_clock.cc:648] HybridClock initialized: now 1790174639894164 us; error 48 us; skew 500 ppm
Sep 23 14:43:59 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174639, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:43:59.897171 874 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:43:59.897996 874 webserver.cc:460] Webserver started at http://127.17.4.190:37273/ using document root <none> and password file <none>
I20260923 14:43:59.898528 874 fs_manager.cc:359] Metadata directory not provided
I20260923 14:43:59.898597 874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:43:59.902410 874 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:59.904467 890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:43:59.905710 874 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:43:59.905856 874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "3c9cced63f284c0ab82d0d6a10c7a149"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "640723de0e27264a4f0725cac6ce26f7"
server_key_iv: "219638d91768a839af685ac20b42c3e7"
server_key_version: "encryptionkey@0"
I20260923 14:43:59.906466 874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:43:59.916735 874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:43:59.920069 874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:43:59.920286 874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:43:59.927568 874 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44699
I20260923 14:43:59.927891 943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44699 every 8 connection(s)
I20260923 14:43:59.928804 874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:43:59.933022 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 874
I20260923 14:43:59.933516 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:37151
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:44699
--webserver_port=37967
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:43:59.934260 944 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:43:59.936626 944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap starting.
I20260923 14:43:59.954530 944 log.cc:824] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Log is configured to *not* fsync() on all Append() calls
I20260923 14:43:59.963115 944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:43:59.963518 944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap complete.
I20260923 14:43:59.967590 944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:59.968132 944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9cced63f284c0ab82d0d6a10c7a149, State: Initialized, Role: FOLLOWER
I20260923 14:43:59.968623 944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:59.968767 944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:43:59.968864 944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:43:59.968966 944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 1 FOLLOWER]: Advancing to term 2
I20260923 14:43:59.970860 944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:59.971210 944 leader_election.cc:302] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c9cced63f284c0ab82d0d6a10c7a149; no voters:
I20260923 14:43:59.971556 944 leader_election.cc:288] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 14:43:59.971643 948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 14:43:59.971866 948 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 LEADER]: Becoming Leader. State: Replica: 3c9cced63f284c0ab82d0d6a10c7a149, State: Running, Role: LEADER
I20260923 14:43:59.972229 948 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:43:59.972823 944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:43:59.973167 948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c9cced63f284c0ab82d0d6a10c7a149. Latest consensus state: current_term: 2 leader_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } } }
I20260923 14:43:59.973376 948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:59.973558 949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } } }
I20260923 14:43:59.973742 949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: This master's current role is: LEADER
I20260923 14:43:59.973817 952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:43:59.979212 952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:43:59.980108 952 catalog_manager.cc:1259] Loaded cluster ID: a0189f75b646490fa59bfa657b19d8c0
I20260923 14:43:59.980176 952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:43:59.982671 952 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:43:59.983392 952 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Loaded TSK: 0
I20260923 14:43:59.998847 952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Generated new TSK 1
I20260923 14:43:59.999114 952 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 14:44:00.051077 946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:00.051326 946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:00.051380 946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:00.055402 946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:00.055460 946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:00.055517 946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:00.060856 946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:37151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=37967
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:00.061857 946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:00.062855 946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:00.072600 971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:00.072580 972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:00.072827 946 server_base.cc:1034] running on GCE node
W20260923 14:44:00.072604 974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:00.074055 946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:00.074697 946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:00.075837 946 hybrid_clock.cc:648] HybridClock initialized: now 1790174640075808 us; error 46 us; skew 500 ppm
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174640, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:00.078598 946 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:44:00.079463 946 webserver.cc:460] Webserver started at http://127.17.4.129:37967/ using document root <none> and password file <none>
I20260923 14:44:00.080075 946 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:00.080152 946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:00.084052 946 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:00.086350 981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.087648 946 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:00.087821 946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "09d8bab3da49466cae651c0cf7038071"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "450cbb3c7ed19c89467d3238a1c77d78"
server_key_iv: "197a5f18c644eabc07ef2753b9cbac6e"
server_key_version: "encryptionkey@0"
I20260923 14:44:00.088392 946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:00.111272 946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:00.114997 946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:00.115221 946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:00.115911 946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:00.117131 988 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 14:44:00.121315 946 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 14:44:00.121372 946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260923 14:44:00.121423 946 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 14:44:00.123106 946 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 14:44:00.123163 946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260923 14:44:00.123426 988 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Bootstrap starting.
I20260923 14:44:00.134683 946 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:37151
I20260923 14:44:00.134773 1095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:37151 every 8 connection(s)
I20260923 14:44:00.136027 946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:00.140893 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 946
I20260923 14:44:00.141407 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:39159
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:44699
--webserver_port=37371
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:44:00.145159 988 log.cc:824] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Log is configured to *not* fsync() on all Append() calls
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174640, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:00.154245 1098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.138199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:46551)
0923 14:44:00.138689 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.138745 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.139599 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.141107 (+ 1508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.141116 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.141629 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:00.142360 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.142384 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.144444 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.144448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.145400 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.145411 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.146447 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.146451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.146653 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.147342 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:00.147359 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:00.148866 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:00.151091 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.151097 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.151111 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.151378 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.151745 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.151750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.151752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.151930 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.152523 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:00.152529 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:00.152776 (+ 247us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.152965 (+ 189us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.153313 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":144,"threads_started":1}
I20260923 14:44:00.154232 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.138251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:46551 (local address 127.17.4.190:44699)
0923 14:44:00.138851 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.138870 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.138921 (+ 51us) server_negotiation.cc:407] Connection header received
0923 14:44:00.140150 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.140167 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.140612 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.141009 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:00.142604 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.144254 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.145572 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.146298 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.146484 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.149094 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:00.149099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:00.149112 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:00.149145 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:00.150933 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.151505 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.151511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.151516 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.151641 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.152037 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.152041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.152043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.152391 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:00.152542 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.153091 (+ 549us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.153348 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":144,"threads_started":1}
I20260923 14:44:00.155817 988 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:44:00.156283 988 tablet_bootstrap.cc:492] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Bootstrap complete.
I20260923 14:44:00.156912 1096 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44699
I20260923 14:44:00.157158 1096 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:00.157604 1096 heartbeater.cc:511] Master 127.17.4.190:44699 requested a full tablet report, sending...
I20260923 14:44:00.157810 988 ts_tablet_manager.cc:1397] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Time spent bootstrapping tablet: real 0.035s user 0.020s sys 0.011s
I20260923 14:44:00.160784 907 ts_manager.cc:194] Registered new tserver with Master: 09d8bab3da49466cae651c0cf7038071 (127.17.4.129:37151)
I20260923 14:44:00.160846 988 raft_consensus.cc:348] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.161388 988 raft_consensus.cc:729] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d8bab3da49466cae651c0cf7038071, State: Initialized, Role: FOLLOWER
I20260923 14:44:00.161928 988 consensus_queue.cc:260] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.163029 988 ts_tablet_manager.cc:1428] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:44:00.164693 907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:46551
I20260923 14:44:00.167332 1096 heartbeater.cc:503] Master 127.17.4.190:44699 was elected leader, sending a full tablet report...
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174639, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.129@KRBTEST.COM
I20260923 14:44:00.176295 1103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.164182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37151 (local address 127.0.0.1:44192)
0923 14:44:00.165263 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.165311 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.165447 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.166050 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.166056 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.166489 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:00.166621 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.166628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.168088 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.168094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.169155 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.169168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.169743 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.169747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.169860 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.170423 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:00.170438 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:00.172079 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:00.174441 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.174454 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.174459 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.174712 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.175036 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.175038 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.175040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.175117 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.175618 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:00.175623 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:00.175727 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.175939 (+ 212us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.176115 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"thread_start_us":112,"threads_started":1}
I20260923 14:44:00.176373 1104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.164260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44192 (local address 127.17.4.129:37151)
0923 14:44:00.164995 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.165014 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.165579 (+ 565us) server_negotiation.cc:407] Connection header received
0923 14:44:00.165667 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.165672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.165876 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.166002 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:00.166749 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.167948 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.169273 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.169619 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.169704 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.172238 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:00.172249 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:00.172261 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:00.172287 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:00.174329 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.174834 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.174840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.174842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.174938 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.175204 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.175207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.175208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.175479 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:00.175612 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.176038 (+ 426us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.176194 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":103,"threads_started":1}
I20260923 14:44:00.177479 1030 tablet_service.cc:1514] Processing DeleteTablet for tablet ef4c8c17421149a99dd1c670565713d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:43:39 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:44192
I20260923 14:44:00.178319 1105 tablet_replica.cc:330] stopping tablet replica
I20260923 14:44:00.178617 1105 raft_consensus.cc:2229] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:00.178876 1105 raft_consensus.cc:2258] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:00.179893 1105 ts_tablet_manager.cc:1905] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:00.183629 1105 ts_tablet_manager.cc:1918] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:00.183712 1105 log.cc:1196] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal/wals/ef4c8c17421149a99dd1c670565713d7
I20260923 14:44:00.184046 1105 ts_tablet_manager.cc:1939] T ef4c8c17421149a99dd1c670565713d7 P 09d8bab3da49466cae651c0cf7038071: Deleting consensus metadata
I20260923 14:44:00.185761 894 catalog_manager.cc:4841] TS 09d8bab3da49466cae651c0cf7038071 (127.17.4.129:37151): tablet ef4c8c17421149a99dd1c670565713d7 (table test-table [id=7b971417ed7f4c2ca956d83d5acec947]) successfully deleted
W20260923 14:44:00.264803 1100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:00.265100 1100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:00.265184 1100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:00.269238 1100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:00.269315 1100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:00.269404 1100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:00.274705 1100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:39159
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=37371
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:00.275705 1100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:00.276719 1100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:00.285931 1111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:00.286007 1113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:00.285965 1110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:00.286266 1100 server_base.cc:1034] running on GCE node
I20260923 14:44:00.286731 1100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:00.287364 1100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:00.288545 1100 hybrid_clock.cc:648] HybridClock initialized: now 1790174640288535 us; error 30 us; skew 500 ppm
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174640, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:00.291165 1100 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:44:00.292203 1100 webserver.cc:460] Webserver started at http://127.17.4.130:37371/ using document root <none> and password file <none>
I20260923 14:44:00.292758 1100 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:00.292865 1100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:00.296568 1100 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:00.298477 1120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.299717 1100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:00.299873 1100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "04b1d4421a4a47e8ac764403962a113b"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "a96d06881f4e9f6d4f36857a911698e8"
server_key_iv: "65fc15253fc57d89fb690766abe65d7d"
server_key_version: "encryptionkey@0"
I20260923 14:44:00.300411 1100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:00.319067 1100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:00.322184 1100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:00.322402 1100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:00.322983 1100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:00.323864 1100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:00.323935 1100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.324007 1100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:00.324059 1100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.333537 1100 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39159
I20260923 14:44:00.333562 1235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39159 every 8 connection(s)
I20260923 14:44:00.334609 1100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:44:00.339888 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1100
I20260923 14:44:00.340323 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:35557
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:44699
--webserver_port=43265
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174640, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:00.349124 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.336343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:50765 (local address 127.17.4.190:44699)
0923 14:44:00.336485 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.336491 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.337425 (+ 934us) server_negotiation.cc:407] Connection header received
0923 14:44:00.338815 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.338818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.338877 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.338993 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:00.340279 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.340893 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.342065 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.342307 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.342424 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.345326 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:00.345337 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:00.345339 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:00.345367 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:00.346863 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.347452 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.347455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.347457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.347540 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.347943 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.347947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.347948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.348138 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:00.348248 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.348777 (+ 529us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.348946 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:44:00.349915 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.336832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:50765)
0923 14:44:00.337278 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.337320 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.338603 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.339166 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.339172 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.339536 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:00.340129 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.340145 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.341027 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.341031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.341923 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.341933 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.342462 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.342467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.342687 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.343332 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:00.343357 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:00.345139 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:00.346999 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.347005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.347021 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.347283 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.347640 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.347643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.347645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.347839 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.348246 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:00.348253 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:00.348509 (+ 256us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.348722 (+ 213us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.349072 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":122,"threads_started":1}
I20260923 14:44:00.351127 1236 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44699
I20260923 14:44:00.351375 1236 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:00.351930 1236 heartbeater.cc:511] Master 127.17.4.190:44699 requested a full tablet report, sending...
I20260923 14:44:00.352985 907 ts_manager.cc:194] Registered new tserver with Master: 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159)
I20260923 14:44:00.353747 907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:50765
W20260923 14:44:00.453948 1239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:00.454211 1239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:00.454253 1239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:00.458349 1239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:00.458410 1239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:00.458467 1239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:00.464192 1239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:35557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=43265
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:00.465189 1239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:00.466163 1239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:00.476016 1244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:00.476018 1245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:00.476032 1247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:00.476207 1239 server_base.cc:1034] running on GCE node
I20260923 14:44:00.476776 1239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:00.477335 1239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:00.478493 1239 hybrid_clock.cc:648] HybridClock initialized: now 1790174640478482 us; error 24 us; skew 500 ppm
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174640, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:00.481232 1239 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:44:00.482050 1239 webserver.cc:460] Webserver started at http://127.17.4.131:43265/ using document root <none> and password file <none>
I20260923 14:44:00.482666 1239 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:00.482738 1239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:00.486335 1239 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:00.488435 1254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.489639 1239 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:00.489728 1239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b33ffbb338604fa085d9dd848c8eb22e"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "86a38267609f61661eeac223e41d5330"
server_key_iv: "486e0547d7d56f06f8887130f67ff1b8"
server_key_version: "encryptionkey@0"
I20260923 14:44:00.490236 1239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:00.505218 1239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:00.508520 1239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:00.508718 1239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:00.509300 1239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:00.510190 1239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:00.510237 1239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.510305 1239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:00.510344 1239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:00.519142 1239 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:35557
I20260923 14:44:00.519191 1368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:35557 every 8 connection(s)
I20260923 14:44:00.520263 1239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:00.527153 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1239
Sep 23 14:44:00 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174640, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:00.534456 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.521985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:42843 (local address 127.17.4.190:44699)
0923 14:44:00.522147 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.522151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.522980 (+ 829us) server_negotiation.cc:407] Connection header received
0923 14:44:00.524334 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.524337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.524384 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.524458 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:00.525580 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.526101 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.527510 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.527749 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.527896 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.530360 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:00.530363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:00.530366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:00.530398 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:00.531967 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.532615 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.532619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.532623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.532727 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.533181 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.533186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.533188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.533426 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:00.533552 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.534093 (+ 541us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.534284 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:44:00.535326 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.522367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:42843)
0923 14:44:00.522821 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.522863 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.524141 (+ 1278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.524624 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.524631 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.524986 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:00.525453 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.525465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.526356 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.526359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.527390 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.527400 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.527956 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.527964 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.528162 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.528766 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:00.528782 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:00.530188 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:00.532098 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.532104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.532119 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.532438 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.532858 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:00.532861 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:00.532864 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:00.533079 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:00.533553 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:00.533598 (+ 45us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:00.533852 (+ 254us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.534050 (+ 198us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.534393 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":100,"threads_started":1}
I20260923 14:44:00.536162 1372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.527877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.17.4.190:44699)
0923 14:44:00.528108 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.528113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.528253 (+ 140us) server_negotiation.cc:407] Connection header received
0923 14:44:00.528404 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.528409 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.528463 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.528557 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:00.529343 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.529870 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.530840 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.531235 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.531355 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.532757 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:00.532762 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:00.532766 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:00.532792 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:00.534353 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.534843 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.534849 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.534850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.534928 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.535220 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.535223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.535225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.535410 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:00.535615 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.535863 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.535981 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":66,"threads_started":1}
I20260923 14:44:00.536605 1369 heartbeater.cc:347] Connected to a master server at 127.17.4.190:44699
I20260923 14:44:00.536835 1369 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:00.537388 1369 heartbeater.cc:511] Master 127.17.4.190:44699 requested a full tablet report, sending...
I20260923 14:44:00.538300 907 ts_manager.cc:194] Registered new tserver with Master: b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
I20260923 14:44:00.538822 907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:42843
I20260923 14:44:00.549460 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:00.553093 1372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.550069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.17.4.190:44699)
0923 14:44:00.550186 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.550190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.550378 (+ 188us) server_negotiation.cc:407] Connection header received
0923 14:44:00.550506 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.550508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.550593 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.550669 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:00.550836 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.551326 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.552169 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.552379 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.552453 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.552699 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:00.552815 (+ 116us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0923 14:44:00.553007 (+ 192us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40564: token expired
Metrics: {"server-negotiator.queue_time_us":46}
W20260923 14:44:00.553170 1372 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40564: token expired
W20260923 14:44:00.553553 836 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.4.190:44699)
I20260923 14:44:00.560230 1372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.553892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.17.4.190:44699)
0923 14:44:00.554007 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.554010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.554048 (+ 38us) server_negotiation.cc:407] Connection header received
0923 14:44:00.554144 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.554146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.554176 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.554235 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:00.554795 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.555255 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.556051 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.556251 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.556325 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.557507 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:00.557510 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:00.557512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:00.557532 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:00.558969 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.559316 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.559318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.559319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.559386 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:00.559607 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:00.559609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:00.559610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:00.559754 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:00.559892 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.560046 (+ 154us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.560127 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:44:00.562547 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:00.565778 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:00.573740 1030 tablet_service.cc:1467] Processing CreateTablet for tablet 85951da40ac249c791a13b0aca5010bf (DEFAULT_TABLE table=test-table [id=d0d18133d45d455f96b114ae932101ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:00.574465 1030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85951da40ac249c791a13b0aca5010bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:00.577527 988 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Bootstrap starting.
I20260923 14:44:00.578272 1379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.572712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:35557 (local address 127.0.0.1:55752)
0923 14:44:00.572973 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.572997 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.573081 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.574256 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.574259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.574277 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:00.574369 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.574375 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.575788 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.575794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.576704 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.576715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.577810 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.577813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.577921 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.577970 (+ 49us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.578055 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.578127 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":1,"thread_start_us":109,"threads_started":1}
I20260923 14:44:00.578369 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.573024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.17.4.131:35557)
0923 14:44:00.573540 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.573551 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.573574 (+ 23us) server_negotiation.cc:407] Connection header received
0923 14:44:00.573646 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.573651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.573895 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.574047 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:00.574497 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.575655 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.576837 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.577688 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.577801 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.577957 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.578100 (+ 143us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.578196 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":197,"threads_started":1}
I20260923 14:44:00.578460 988 tablet_bootstrap.cc:654] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:00.579134 1103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.572465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.0.0.1:40470)
0923 14:44:00.572609 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.572625 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.572703 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.573645 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.573648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.573668 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:00.573773 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.573779 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.575351 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.575355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.576658 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.576668 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.578728 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.578732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.578851 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.578874 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.578924 (+ 50us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.579013 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":53}
I20260923 14:44:00.579805 1378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.572660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40470 (local address 127.17.4.130:39159)
0923 14:44:00.573137 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.573150 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.573175 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:44:00.573254 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.573260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.573497 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.573657 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:00.573868 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.575226 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.576794 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.578257 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.579386 (+ 1129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.579530 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.579573 (+ 43us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.579642 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":153,"threads_started":1}
I20260923 14:44:00.580895 988 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: No bootstrap required, opened a new log
I20260923 14:44:00.580996 988 ts_tablet_manager.cc:1397] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260923 14:44:00.581468 988 raft_consensus.cc:348] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.581609 988 raft_consensus.cc:374] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:00.581655 988 raft_consensus.cc:729] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d8bab3da49466cae651c0cf7038071, State: Initialized, Role: FOLLOWER
I20260923 14:44:00.581808 988 consensus_queue.cc:260] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.581492 1302 tablet_service.cc:1467] Processing CreateTablet for tablet 85951da40ac249c791a13b0aca5010bf (DEFAULT_TABLE table=test-table [id=d0d18133d45d455f96b114ae932101ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:00.582576 988 ts_tablet_manager.cc:1428] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:00.582633 1302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85951da40ac249c791a13b0aca5010bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:00.582749 1169 tablet_service.cc:1467] Processing CreateTablet for tablet 85951da40ac249c791a13b0aca5010bf (DEFAULT_TABLE table=test-table [id=d0d18133d45d455f96b114ae932101ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:00.583717 1169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85951da40ac249c791a13b0aca5010bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:00.590775 1382 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Bootstrap starting.
I20260923 14:44:00.591163 1383 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Bootstrap starting.
I20260923 14:44:00.593966 1383 tablet_bootstrap.cc:654] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:00.593966 1382 tablet_bootstrap.cc:654] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:00.594869 1383 log.cc:824] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:00.594869 1382 log.cc:824] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:00.597083 1382 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: No bootstrap required, opened a new log
I20260923 14:44:00.597083 1383 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: No bootstrap required, opened a new log
I20260923 14:44:00.597285 1383 ts_tablet_manager.cc:1397] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:44:00.597285 1382 ts_tablet_manager.cc:1397] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260923 14:44:00.601372 1382 raft_consensus.cc:348] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.601372 1383 raft_consensus.cc:348] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.601702 1383 raft_consensus.cc:374] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:00.601702 1382 raft_consensus.cc:374] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:00.601766 1382 raft_consensus.cc:729] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b33ffbb338604fa085d9dd848c8eb22e, State: Initialized, Role: FOLLOWER
I20260923 14:44:00.601766 1383 raft_consensus.cc:729] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04b1d4421a4a47e8ac764403962a113b, State: Initialized, Role: FOLLOWER
I20260923 14:44:00.602267 1383 consensus_queue.cc:260] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.602267 1382 consensus_queue.cc:260] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.602988 1236 heartbeater.cc:503] Master 127.17.4.190:44699 was elected leader, sending a full tablet report...
I20260923 14:44:00.602994 1369 heartbeater.cc:503] Master 127.17.4.190:44699 was elected leader, sending a full tablet report...
I20260923 14:44:00.603348 1383 ts_tablet_manager.cc:1428] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
I20260923 14:44:00.603348 1382 ts_tablet_manager.cc:1428] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260923 14:44:00.637522 1097 tablet.cc:2369] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:44:00.771267 1370 tablet.cc:2369] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:00.790108 1102 raft_consensus.cc:482] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:00.790373 1102 raft_consensus.cc:504] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.791682 1102 leader_election.cc:288] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
I20260923 14:44:00.796211 1378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.792111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53933 (local address 127.17.4.130:39159)
0923 14:44:00.792294 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.792299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.792408 (+ 109us) server_negotiation.cc:407] Connection header received
0923 14:44:00.792691 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.792696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.792763 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.792879 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:00.793273 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.793993 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.795101 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.795556 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.795651 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.795693 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.795972 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.796051 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:00.796223 1389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.792559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:35557 (local address 127.17.4.129:36923)
0923 14:44:00.792907 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.792922 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.793016 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.793286 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.793289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.793306 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:00.793396 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.793401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.794181 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.794186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.795109 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.795118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.795821 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.795828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.795891 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.795927 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.796007 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.796072 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":76,"threads_started":1}
I20260923 14:44:00.796226 1388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.791985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.17.4.129:53933)
0923 14:44:00.792291 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.792313 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:00.792530 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:00.792908 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:00.792910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:00.792929 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:00.793113 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.793119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.794101 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.794108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.794936 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:00.794974 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.795673 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.795679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:00.795804 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.795858 (+ 54us) client_negotiation.cc:769] Sending connection context
0923 14:44:00.795940 (+ 82us) client_negotiation.cc:240] Negotiation successful
0923 14:44:00.796030 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":11,"thread_start_us":120,"threads_started":1}
I20260923 14:44:00.796262 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.792673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:36923 (local address 127.17.4.131:35557)
0923 14:44:00.792833 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.792856 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.792996 (+ 140us) server_negotiation.cc:407] Connection header received
0923 14:44:00.793129 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.793131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.793192 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.793264 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:00.793520 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.794072 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.795226 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.795651 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.795792 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.795842 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.796049 (+ 207us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.796143 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 14:44:00.797171 1322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85951da40ac249c791a13b0aca5010bf" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b33ffbb338604fa085d9dd848c8eb22e" is_pre_election: true
I20260923 14:44:00.797500 1322 raft_consensus.cc:2454] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 0.
I20260923 14:44:00.797995 985 leader_election.cc:302] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09d8bab3da49466cae651c0cf7038071, b33ffbb338604fa085d9dd848c8eb22e; no voters:
I20260923 14:44:00.798048 1189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85951da40ac249c791a13b0aca5010bf" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b1d4421a4a47e8ac764403962a113b" is_pre_election: true
I20260923 14:44:00.798298 1189 raft_consensus.cc:2454] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 0.
I20260923 14:44:00.798305 1102 raft_consensus.cc:2781] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:00.798400 1102 raft_consensus.cc:482] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:00.798472 1102 raft_consensus.cc:3037] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:00.799649 1102 raft_consensus.cc:504] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.800036 1102 leader_election.cc:288] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 election: Requested vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
I20260923 14:44:00.800547 1322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85951da40ac249c791a13b0aca5010bf" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b33ffbb338604fa085d9dd848c8eb22e"
I20260923 14:44:00.800653 1322 raft_consensus.cc:3037] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:00.801620 1322 raft_consensus.cc:2454] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 1.
I20260923 14:44:00.801789 1189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85951da40ac249c791a13b0aca5010bf" candidate_uuid: "09d8bab3da49466cae651c0cf7038071" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b1d4421a4a47e8ac764403962a113b"
I20260923 14:44:00.801926 985 leader_election.cc:302] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09d8bab3da49466cae651c0cf7038071, b33ffbb338604fa085d9dd848c8eb22e; no voters:
I20260923 14:44:00.801941 1189 raft_consensus.cc:3037] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:00.802119 1102 raft_consensus.cc:2781] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:00.802320 1102 raft_consensus.cc:686] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 LEADER]: Becoming Leader. State: Replica: 09d8bab3da49466cae651c0cf7038071, State: Running, Role: LEADER
I20260923 14:44:00.802582 1102 consensus_queue.cc:237] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:00.803212 1189 raft_consensus.cc:2454] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09d8bab3da49466cae651c0cf7038071 in term 1.
I20260923 14:44:00.805967 906 catalog_manager.cc:5495] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09d8bab3da49466cae651c0cf7038071 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "09d8bab3da49466cae651c0cf7038071" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } health_report { overall_health: HEALTHY } } }
W20260923 14:44:00.835726 1237 tablet.cc:2369] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:00.870815 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.867060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44194 (local address 127.17.4.129:37151)
0923 14:44:00.867386 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:00.867393 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:00.867405 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:44:00.867479 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:00.867481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:00.867533 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:00.867668 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:00.867952 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.868485 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.869329 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:00.869562 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:00.869674 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:00.869943 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:00.870372 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:00.870506 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:00.870591 (+ 85us) server_negotiation.cc:299] Negotiation successful
0923 14:44:00.870654 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":104,"threads_started":1}
I20260923 14:44:00.874866 1189 raft_consensus.cc:1261] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Refusing update from remote peer 09d8bab3da49466cae651c0cf7038071: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:00.874867 1322 raft_consensus.cc:1261] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Refusing update from remote peer 09d8bab3da49466cae651c0cf7038071: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:00.875603 1390 consensus_queue.cc:1035] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:00.875823 1102 consensus_queue.cc:1035] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:00.886919 1394 mvcc.cc:205] Tried to move back new op lower bound from 7332555329016590336 to 7332555328730398720. Current Snapshot: MvccSnapshot[applied={T|T < 7332555329016590336 or (T in {7332555329016590336})}]
I20260923 14:44:00.890950 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:00.891136 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:00.893734 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Sending DeleteTablet for 3 replicas of tablet 85951da40ac249c791a13b0aca5010bf
I20260923 14:44:00.894420 1169 tablet_service.cc:1514] Processing DeleteTablet for tablet 85951da40ac249c791a13b0aca5010bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:00 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:40470
I20260923 14:44:00.894493 1030 tablet_service.cc:1514] Processing DeleteTablet for tablet 85951da40ac249c791a13b0aca5010bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:00 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:44192
I20260923 14:44:00.894737 1302 tablet_service.cc:1514] Processing DeleteTablet for tablet 85951da40ac249c791a13b0aca5010bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:00 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:55752
I20260923 14:44:00.894968 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 946
I20260923 14:44:00.895226 1404 tablet_replica.cc:330] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: stopping tablet replica
I20260923 14:44:00.895730 1404 raft_consensus.cc:2229] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:00.896163 1404 raft_consensus.cc:2258] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:00.896842 1403 tablet_replica.cc:330] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: stopping tablet replica
I20260923 14:44:00.897166 1403 raft_consensus.cc:2229] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:00.897439 1403 raft_consensus.cc:2258] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:00.897687 1404 ts_tablet_manager.cc:1905] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:00.898764 1403 ts_tablet_manager.cc:1905] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:00.900439 1404 ts_tablet_manager.cc:1918] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:00.900552 1404 log.cc:1196] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/85951da40ac249c791a13b0aca5010bf
I20260923 14:44:00.900935 1404 ts_tablet_manager.cc:1939] T 85951da40ac249c791a13b0aca5010bf P b33ffbb338604fa085d9dd848c8eb22e: Deleting consensus metadata
W20260923 14:44:00.901393 894 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:37151 (error 108)
I20260923 14:44:00.901561 1403 ts_tablet_manager.cc:1918] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:00.901657 1403 log.cc:1196] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/85951da40ac249c791a13b0aca5010bf
I20260923 14:44:00.902328 1403 ts_tablet_manager.cc:1939] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Deleting consensus metadata
I20260923 14:44:00.902302 894 catalog_manager.cc:4841] TS b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557): tablet 85951da40ac249c791a13b0aca5010bf (table test-table [id=d0d18133d45d455f96b114ae932101ac]) successfully deleted
I20260923 14:44:00.902333 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 1100
I20260923 14:44:00.902493 1103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.902145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:37151 (local address 127.0.0.1:44210)
0923 14:44:00.902306 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.902387 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260923 14:44:00.903345 894 catalog_manager.cc:4584] TS 09d8bab3da49466cae651c0cf7038071 (127.17.4.129:37151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 85951da40ac249c791a13b0aca5010bf: Network error: Client connection negotiation failed: client connection to 127.17.4.129:37151: connect: Connection refused (error 111)
I20260923 14:44:00.908371 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 1239
I20260923 14:44:00.908689 1103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:00.908416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.0.0.1:40472)
0923 14:44:00.908542 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:00.908601 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.130:39159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260923 14:44:00.914399 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 874
I20260923 14:44:20.921265 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44699
--webserver_interface=127.17.4.190
--webserver_port=37273
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:44699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:21.028883 1406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:21.029143 1406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:21.029186 1406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:21.033272 1406 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 14:44:21.033331 1406 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 14:44:21.033347 1406 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 14:44:21.033362 1406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:21.033409 1406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:21.033443 1406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:21.033473 1406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:21.033509 1406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:21.038852 1406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:44699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:44699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=37273
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:21.040000 1406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:21.041054 1406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:21.049697 1414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:21.049734 1411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:21.049786 1406 server_base.cc:1034] running on GCE node
W20260923 14:44:21.049613 1412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:21.050380 1406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:21.051460 1406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:21.052645 1406 hybrid_clock.cc:648] HybridClock initialized: now 1790174661052609 us; error 49 us; skew 500 ppm
Sep 23 14:44:21 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174661, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:21.055336 1406 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:44:21.056365 1406 webserver.cc:460] Webserver started at http://127.17.4.190:37273/ using document root <none> and password file <none>
I20260923 14:44:21.056975 1406 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:21.057070 1406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:21.060950 1406 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:21.063143 1421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.064730 1406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:44:21.064869 1406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "3c9cced63f284c0ab82d0d6a10c7a149"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "640723de0e27264a4f0725cac6ce26f7"
server_key_iv: "219638d91768a839af685ac20b42c3e7"
server_key_version: "encryptionkey@0"
I20260923 14:44:21.065434 1406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:21.089562 1406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:21.092999 1406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:21.093211 1406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:21.100538 1406 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:44699
I20260923 14:44:21.100847 1473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:44699 every 8 connection(s)
I20260923 14:44:21.101727 1406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:21.106168 1474 sys_catalog.cc:263] Verifying existing consensus state
I20260923 14:44:21.107946 1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap starting.
I20260923 14:44:21.107982 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1406
I20260923 14:44:21.108433 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:37151
--local_ip_for_outbound_sockets=127.17.4.129
--tserver_master_addrs=127.17.4.190:44699
--webserver_port=37967
--webserver_interface=127.17.4.129
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:44:21.126294 1474 log.cc:824] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:21.137632 1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:44:21.138044 1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Bootstrap complete.
I20260923 14:44:21.142117 1474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:44:21.142532 1474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9cced63f284c0ab82d0d6a10c7a149, State: Initialized, Role: FOLLOWER
I20260923 14:44:21.143014 1474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:44:21.143154 1474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:21.143249 1474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:21.143369 1474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 2 FOLLOWER]: Advancing to term 3
I20260923 14:44:21.145268 1474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:44:21.145596 1474 leader_election.cc:302] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c9cced63f284c0ab82d0d6a10c7a149; no voters:
I20260923 14:44:21.145934 1474 leader_election.cc:288] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 14:44:21.146042 1478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 14:44:21.146242 1478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [term 3 LEADER]: Becoming Leader. State: Replica: 3c9cced63f284c0ab82d0d6a10c7a149, State: Running, Role: LEADER
I20260923 14:44:21.146581 1478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } }
I20260923 14:44:21.147168 1474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:21.148090 1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } } }
I20260923 14:44:21.148211 1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:21.148571 1480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c9cced63f284c0ab82d0d6a10c7a149. Latest consensus state: current_term: 3 leader_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c9cced63f284c0ab82d0d6a10c7a149" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 44699 } } }
I20260923 14:44:21.148696 1480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:21.148974 1487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:21.154398 1487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:21.154999 1487 catalog_manager.cc:1259] Loaded cluster ID: a0189f75b646490fa59bfa657b19d8c0
I20260923 14:44:21.155058 1487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:21.157635 1487 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:21.158409 1487 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Loaded TSK: 0
I20260923 14:44:21.158489 1487 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3c9cced63f284c0ab82d0d6a10c7a149: Loaded TSK: 1
F20260923 14:44:21.159180 1487 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2cccf8e9ad google::LogMessage::Fail() at ??:0
@ 0x7f2cccf9188a google::LogMessage::SendToLog() at ??:0
@ 0x7f2cccf8e4de google::LogMessage::Flush() at ??:0
@ 0x7f2cccf8fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2ccfc5218d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2ccfc4af0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2cd78f37bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2cd78cd99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2cd78ce178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f2cd790fdf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f2cd792e82b std::function<>::operator()() at ??:0
@ 0x7f2cd78cdb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f2cd78cef3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2cd78cb579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f2cd790f640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2ccf1e03d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2ccf1e0c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f2ccf1e23f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2ccf1d1512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2cd08156db start_thread at ??:0
@ 0x7f2ccba8c61f clone at ??:0
W20260923 14:44:21.255138 1476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:21.255537 1476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:21.255612 1476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:21.261929 1476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:21.262008 1476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:21.262100 1476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:21.270153 1476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:37151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=37967
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:21.271494 1476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:21.272887 1476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:21.284852 1522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:21.284879 1523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:21.284914 1525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:21.285243 1476 server_base.cc:1034] running on GCE node
I20260923 14:44:21.285606 1476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:21.286247 1476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:21.287434 1476 hybrid_clock.cc:648] HybridClock initialized: now 1790174661287411 us; error 41 us; skew 500 ppm
Sep 23 14:44:21 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174661, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:21.290369 1476 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:44:21.291177 1476 webserver.cc:460] Webserver started at http://127.17.4.129:37967/ using document root <none> and password file <none>
I20260923 14:44:21.291726 1476 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:21.291855 1476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:21.295697 1476 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260923 14:44:21.297971 1532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.299220 1476 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:44:21.299351 1476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "09d8bab3da49466cae651c0cf7038071"
format_stamp: "Formatted at 2026-09-23 14:43:38 on dist-test-slave-54kg"
server_key: "450cbb3c7ed19c89467d3238a1c77d78"
server_key_iv: "197a5f18c644eabc07ef2753b9cbac6e"
server_key_version: "encryptionkey@0"
I20260923 14:44:21.299984 1476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:21.316936 1476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:21.320441 1476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:21.320654 1476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:21.321267 1476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:21.322364 1539 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 14:44:21.327934 1476 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 14:44:21.328091 1476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260923 14:44:21.328202 1476 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 14:44:21.330482 1476 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 14:44:21.330576 1476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:21.331130 1539 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Bootstrap starting.
I20260923 14:44:21.342126 1476 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:37151
I20260923 14:44:21.342186 1647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:37151 every 8 connection(s)
I20260923 14:44:21.343241 1476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:21.345417 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1476
I20260923 14:44:21.345927 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:39159
--local_ip_for_outbound_sockets=127.17.4.130
--tserver_master_addrs=127.17.4.190:44699
--webserver_port=37371
--webserver_interface=127.17.4.130
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:44:21.355067 1539 log.cc:824] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:21.362205 1539 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 14:44:21.362619 1539 tablet_bootstrap.cc:492] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Bootstrap complete.
I20260923 14:44:21.363905 1539 ts_tablet_manager.cc:1397] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.015s
I20260923 14:44:21.366320 1539 raft_consensus.cc:348] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:21.366770 1539 raft_consensus.cc:729] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d8bab3da49466cae651c0cf7038071, State: Initialized, Role: FOLLOWER
I20260923 14:44:21.367283 1539 consensus_queue.cc:260] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:21.368288 1539 ts_tablet_manager.cc:1428] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
W20260923 14:44:21.424104 1650 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:44:21.345360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:55309)
0923 14:44:21.346788 (+ 1428us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.346859 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:21.348063 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:21.423110 (+ 75047us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1148,"thread_start_us":154,"threads_started":1}
W20260923 14:44:21.424715 1648 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44699 (0 consecutive failures): Network error: Failed to ping master at 127.17.4.190:44699: Client connection negotiation failed: client connection to 127.17.4.190:44699: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 14:44:21.425513 1650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.425229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:45731)
0923 14:44:21.425371 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.425450 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 14:44:21.426172 1650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.425964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:52551)
0923 14:44:21.426068 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.426117 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 14:44:21.426352 1648 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 14:44:21.483198 1651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:21.483448 1651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:21.483494 1651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:21.487402 1651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:21.487449 1651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:21.487504 1651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:21.492563 1651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:39159
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=37371
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:21.493445 1651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:21.494412 1651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:21.503727 1659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:21.503803 1651 server_base.cc:1034] running on GCE node
W20260923 14:44:21.503716 1658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:21.503737 1661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:21.504552 1651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:21.505151 1651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:21.506364 1651 hybrid_clock.cc:648] HybridClock initialized: now 1790174661506355 us; error 30 us; skew 500 ppm
Sep 23 14:44:21 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174661, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:21.509208 1651 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:44:21.510043 1651 webserver.cc:460] Webserver started at http://127.17.4.130:37371/ using document root <none> and password file <none>
I20260923 14:44:21.510601 1651 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:21.510699 1651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:21.514423 1651 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:44:21.516525 1668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.517755 1651 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:44:21.517889 1651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "04b1d4421a4a47e8ac764403962a113b"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "a96d06881f4e9f6d4f36857a911698e8"
server_key_iv: "65fc15253fc57d89fb690766abe65d7d"
server_key_version: "encryptionkey@0"
I20260923 14:44:21.518428 1651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:21.534497 1651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:21.538041 1651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:21.538259 1651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:21.538813 1651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:21.539924 1675 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260923 14:44:21.543459 1675 ts_tablet_manager.cc:1852] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260923 14:44:21.543854 1675 ts_tablet_manager.cc:1905] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:21.547722 1675 ts_tablet_manager.cc:1918] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:21.547926 1675 ts_tablet_manager.cc:1939] T 85951da40ac249c791a13b0aca5010bf P 04b1d4421a4a47e8ac764403962a113b: Deleting consensus metadata
I20260923 14:44:21.548262 1651 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260923 14:44:21.548326 1651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.009s user 0.001s sys 0.000s
I20260923 14:44:21.548374 1651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:21.548403 1651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.557399 1651 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39159
I20260923 14:44:21.557441 1782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39159 every 8 connection(s)
I20260923 14:44:21.558256 1651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:44:21.561710 1785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.560424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:45149)
0923 14:44:21.560922 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.561028 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":124,"threads_started":1}
W20260923 14:44:21.562216 1783 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44699 (0 consecutive failures): Network error: Failed to ping master at 127.17.4.190:44699: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
I20260923 14:44:21.562831 1785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.562624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:60037)
0923 14:44:21.562732 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.562780 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 14:44:21.563365 1785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.563192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:55901)
0923 14:44:21.563283 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.563322 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 14:44:21.563536 1783 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 14:44:21.566946 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1651
I20260923 14:44:21.567314 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:35557
--local_ip_for_outbound_sockets=127.17.4.131
--tserver_master_addrs=127.17.4.190:44699
--webserver_port=43265
--webserver_interface=127.17.4.131
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:44423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:21.679351 1786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:21.679646 1786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:21.679728 1786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:21.683714 1786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:21.683835 1786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:21.683961 1786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:21.689123 1786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:44423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:35557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=43265
--tserver_master_addrs=127.17.4.190:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:21.690287 1786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:21.691298 1786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:21.700608 1794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:21.700704 1792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:21.700608 1791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:21.701020 1786 server_base.cc:1034] running on GCE node
I20260923 14:44:21.701431 1786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:21.702067 1786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:21.703253 1786 hybrid_clock.cc:648] HybridClock initialized: now 1790174661703238 us; error 26 us; skew 500 ppm
Sep 23 14:44:21 dist-test-slave-54kg krb5kdc[323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174661, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:21.706017 1786 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:44:21.706862 1786 webserver.cc:460] Webserver started at http://127.17.4.131:43265/ using document root <none> and password file <none>
I20260923 14:44:21.707363 1786 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:21.707422 1786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:21.711102 1786 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:21.713160 1801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.714357 1786 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:21.714474 1786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "b33ffbb338604fa085d9dd848c8eb22e"
format_stamp: "Formatted at 2026-09-23 14:43:39 on dist-test-slave-54kg"
server_key: "86a38267609f61661eeac223e41d5330"
server_key_iv: "486e0547d7d56f06f8887130f67ff1b8"
server_key_version: "encryptionkey@0"
I20260923 14:44:21.714988 1786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:21.733481 1786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:21.736382 1786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:21.736572 1786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:21.737130 1786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:21.737941 1786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:21.737985 1786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.738054 1786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:21.738092 1786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:21.746948 1786 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:35557
I20260923 14:44:21.746971 1915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:35557 every 8 connection(s)
I20260923 14:44:21.747967 1786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:21.751876 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.750095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:38869)
0923 14:44:21.750567 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.750673 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":103,"threads_started":1}
W20260923 14:44:21.752307 1916 heartbeater.cc:644] Failed to heartbeat to 127.17.4.190:44699 (0 consecutive failures): Network error: Failed to ping master at 127.17.4.190:44699: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
I20260923 14:44:21.752915 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.752700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:38645)
0923 14:44:21.752805 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.752855 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 14:44:21.753499 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:21.753306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:35427)
0923 14:44:21.753407 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:21.753451 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 14:44:21.753536 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1786
W20260923 14:44:21.753752 1916 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 14:44:22.427503 1920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:22.427017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:33127)
0923 14:44:22.427317 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:22.427400 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":77,"threads_started":1}
I20260923 14:44:22.564617 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:22.564193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:50565)
0923 14:44:22.564456 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:22.564517 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":70,"threads_started":1}
I20260923 14:44:22.754832 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:22.754381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:50725)
0923 14:44:22.754663 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:22.754728 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":99,"threads_started":1}
I20260923 14:44:23.189478 1923 raft_consensus.cc:482] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:23.189670 1923 raft_consensus.cc:504] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:23.190704 1923 leader_election.cc:288] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
Sep 23 14:44:23 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174661, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.130@KRBTEST.COM
Sep 23 14:44:23 dist-test-slave-54kg krb5kdc[323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174661, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.131@KRBTEST.COM
I20260923 14:44:23.212713 1926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.191317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:35557 (local address 127.17.4.129:51417)
0923 14:44:23.191571 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:23.191586 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:23.191695 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:23.193722 (+ 2027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:23.193729 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:23.194354 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:23.195189 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:23.195211 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.197187 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.197191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:23.198921 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:23.198933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.199923 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.199928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:23.200236 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:23.205516 (+ 5280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:23.205547 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:23.207905 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:23.210167 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:23.210169 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:23.210171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:23.210469 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:23.210857 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:23.210859 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:23.210860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:23.210966 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:23.211629 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:23.211632 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:23.211961 (+ 329us) client_negotiation.cc:769] Sending connection context
0923 14:44:23.212151 (+ 190us) client_negotiation.cc:240] Negotiation successful
0923 14:44:23.212508 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":385,"spinlock_wait_cycles":66944,"thread_start_us":74,"threads_started":1}
I20260923 14:44:23.212714 1925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.191129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:35013 (local address 127.17.4.130:39159)
0923 14:44:23.191691 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:23.191720 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:23.191800 (+ 80us) server_negotiation.cc:407] Connection header received
0923 14:44:23.192740 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:23.192749 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:23.193207 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:23.193546 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:23.195392 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.197002 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.199053 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.199789 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.199956 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:23.207886 (+ 7930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:23.207894 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:23.207913 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:23.207951 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:23.209958 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:23.210562 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:23.210568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:23.210575 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:23.210712 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:23.211065 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:23.211068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:23.211070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:23.211491 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:23.211629 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:23.212263 (+ 634us) server_negotiation.cc:299] Negotiation successful
0923 14:44:23.212519 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":126,"threads_started":1}
I20260923 14:44:23.212733 1927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.191608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:51417 (local address 127.17.4.131:35557)
0923 14:44:23.191925 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:23.191948 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:23.191981 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:44:23.192740 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:23.192749 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:23.193211 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:23.193546 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:23.195392 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.197002 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.199053 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.199788 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.199956 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:23.208105 (+ 8149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:23.208110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:23.208120 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:23.208150 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:23.210003 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:23.210606 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:23.210610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:23.210614 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:23.210724 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:23.211064 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:23.211068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:23.211070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:23.211491 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:23.211629 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:23.212277 (+ 648us) server_negotiation.cc:299] Negotiation successful
0923 14:44:23.212544 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":88,"threads_started":1}
I20260923 14:44:23.212770 1924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.190944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39159 (local address 127.17.4.129:35013)
0923 14:44:23.191147 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:23.191162 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:23.191268 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:23.193722 (+ 2454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:23.193729 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:23.194354 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:23.195189 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:23.195211 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.197187 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.197191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:23.198921 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:23.198933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:23.199923 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:23.199928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:23.200240 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:23.205516 (+ 5276us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:23.205547 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:23.207536 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:23.210105 (+ 2569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:23.210112 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:23.210126 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:23.210436 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:23.210824 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:23.210827 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:23.210829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:23.210964 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:23.211621 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:23.211628 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:23.211958 (+ 330us) client_negotiation.cc:769] Sending connection context
0923 14:44:23.212151 (+ 193us) client_negotiation.cc:240] Negotiation successful
0923 14:44:23.212591 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":654,"spinlock_wait_cycles":21120,"thread_start_us":60,"threads_started":1}
W20260923 14:44:23.215942 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
W20260923 14:44:23.216569 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
I20260923 14:44:23.216645 1536 leader_election.cc:302] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09d8bab3da49466cae651c0cf7038071; no voters: 04b1d4421a4a47e8ac764403962a113b, b33ffbb338604fa085d9dd848c8eb22e
I20260923 14:44:23.216871 1923 raft_consensus.cc:2726] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:44:23.428675 1924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.428335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:56787)
0923 14:44:23.428509 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:23.428579 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260923 14:44:23.565686 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.565309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:40433)
0923 14:44:23.565555 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:23.565606 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":80,"threads_started":1}
I20260923 14:44:23.756163 1929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:23.755717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:40833)
0923 14:44:23.756009 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:23.756063 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":127,"threads_started":1}
I20260923 14:44:24.429898 1930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:24.429423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:53769)
0923 14:44:24.429745 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:24.429801 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":106,"threads_started":1}
I20260923 14:44:24.566862 1931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:24.566329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:50097)
0923 14:44:24.566709 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:24.566765 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":84,"threads_started":1}
I20260923 14:44:24.730315 1932 raft_consensus.cc:482] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:24.730470 1932 raft_consensus.cc:504] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:24.730896 1932 leader_election.cc:288] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
W20260923 14:44:24.731861 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
W20260923 14:44:24.731998 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
I20260923 14:44:24.732060 1536 leader_election.cc:302] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09d8bab3da49466cae651c0cf7038071; no voters: 04b1d4421a4a47e8ac764403962a113b, b33ffbb338604fa085d9dd848c8eb22e
I20260923 14:44:24.732265 1932 raft_consensus.cc:2726] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:44:24.757165 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:24.756812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:46799)
0923 14:44:24.757034 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:24.757083 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
I20260923 14:44:25.430992 1934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:25.430598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:33381)
0923 14:44:25.430845 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:25.430899 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":77,"threads_started":1}
I20260923 14:44:25.567957 1935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:25.567549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:33417)
0923 14:44:25.567807 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:25.567858 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":67,"threads_started":1}
I20260923 14:44:25.758221 1936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:25.757851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:45989)
0923 14:44:25.758079 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:25.758134 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260923 14:44:26.432507 1937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:26.431996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:56511)
0923 14:44:26.432347 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:26.432408 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":98,"threads_started":1}
I20260923 14:44:26.569150 1938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:26.568760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:60091)
0923 14:44:26.569006 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:26.569062 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":90,"threads_started":1}
I20260923 14:44:26.589246 1939 raft_consensus.cc:482] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:26.589377 1939 raft_consensus.cc:504] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:26.589844 1939 leader_election.cc:288] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
W20260923 14:44:26.590673 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
W20260923 14:44:26.590808 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
I20260923 14:44:26.590862 1536 leader_election.cc:302] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09d8bab3da49466cae651c0cf7038071; no voters: 04b1d4421a4a47e8ac764403962a113b, b33ffbb338604fa085d9dd848c8eb22e
I20260923 14:44:26.591069 1939 raft_consensus.cc:2726] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:44:26.759375 1940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:26.758962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:34101)
0923 14:44:26.759231 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:26.759285 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":76,"threads_started":1}
I20260923 14:44:27.433874 1941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:27.433327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:45087)
0923 14:44:27.433673 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:27.433746 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":113,"threads_started":1}
I20260923 14:44:27.570214 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:27.569821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:35601)
0923 14:44:27.570071 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:27.570125 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":80,"threads_started":1}
I20260923 14:44:27.760550 1943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:27.760149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:55877)
0923 14:44:27.760393 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:27.760447 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":71,"threads_started":1}
I20260923 14:44:28.435106 1944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:28.434711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:36363)
0923 14:44:28.434955 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:28.435010 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
I20260923 14:44:28.571376 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:28.570901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:42591)
0923 14:44:28.571229 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:28.571285 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":71,"threads_started":1}
I20260923 14:44:28.761662 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:28.761247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:34045)
0923 14:44:28.761518 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:28.761568 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":70,"threads_started":1}
I20260923 14:44:29.436457 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:29.436019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:45761)
0923 14:44:29.436297 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:29.436360 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":91,"threads_started":1}
I20260923 14:44:29.572528 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:29.572134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:35579)
0923 14:44:29.572383 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:29.572438 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
I20260923 14:44:29.762853 1949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:29.762431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:35583)
0923 14:44:29.762705 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:29.762761 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":73,"threads_started":1}
I20260923 14:44:30.437608 1950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:30.437190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:44769)
0923 14:44:30.437450 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:30.437506 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":82,"threads_started":1}
I20260923 14:44:30.573616 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:30.573236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:42931)
0923 14:44:30.573475 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:30.573526 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
I20260923 14:44:30.764063 1952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:30.763574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:49821)
0923 14:44:30.763913 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:30.763970 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":82,"threads_started":1}
I20260923 14:44:31.249697 1953 raft_consensus.cc:482] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:31.249843 1953 raft_consensus.cc:504] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b1d4421a4a47e8ac764403962a113b" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39159 } } peers { permanent_uuid: "b33ffbb338604fa085d9dd848c8eb22e" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 35557 } } peers { permanent_uuid: "09d8bab3da49466cae651c0cf7038071" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 37151 } }
I20260923 14:44:31.250275 1953 leader_election.cc:288] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159), b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557)
W20260923 14:44:31.251062 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04b1d4421a4a47e8ac764403962a113b (127.17.4.130:39159): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
W20260923 14:44:31.251250 1536 leader_election.cc:341] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b33ffbb338604fa085d9dd848c8eb22e (127.17.4.131:35557): Not found: Tablet not found: 85951da40ac249c791a13b0aca5010bf
I20260923 14:44:31.251313 1536 leader_election.cc:302] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09d8bab3da49466cae651c0cf7038071; no voters: 04b1d4421a4a47e8ac764403962a113b, b33ffbb338604fa085d9dd848c8eb22e
I20260923 14:44:31.251463 1953 raft_consensus.cc:2726] T 85951da40ac249c791a13b0aca5010bf P 09d8bab3da49466cae651c0cf7038071 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 14:44:31.438997 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:31.438551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:58879)
0923 14:44:31.438837 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:31.438904 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":79,"threads_started":1}
I20260923 14:44:31.574898 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:31.574454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:46127)
0923 14:44:31.574743 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:31.574807 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
I20260923 14:44:31.765305 1956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:31.764858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:49169)
0923 14:44:31.765137 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:31.765211 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":72,"threads_started":1}
I20260923 14:44:32.440181 1957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:32.439725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:58405)
0923 14:44:32.439993 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:32.440044 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":89,"threads_started":1}
I20260923 14:44:32.576115 1958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:32.575646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:41939)
0923 14:44:32.575957 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:32.576013 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":112,"threads_started":1}
I20260923 14:44:32.766481 1959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:32.766084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:49745)
0923 14:44:32.766331 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:32.766387 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":79,"threads_started":1}
I20260923 14:44:33.441390 1960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:33.440981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:51111)
0923 14:44:33.441229 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:33.441290 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":73,"threads_started":1}
I20260923 14:44:33.577207 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:33.576813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:57575)
0923 14:44:33.577049 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:33.577108 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260923 14:44:33.767755 1962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:33.767309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:33657)
0923 14:44:33.767600 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:33.767660 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":93,"threads_started":1}
I20260923 14:44:34.442553 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:34.442106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:54283)
0923 14:44:34.442401 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:34.442455 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":126,"threads_started":1}
I20260923 14:44:34.578408 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:34.577932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:48243)
0923 14:44:34.578253 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:34.578313 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":89,"threads_started":1}
I20260923 14:44:34.768916 1965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:34.768503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:34295)
0923 14:44:34.768767 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:34.768821 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
I20260923 14:44:35.443899 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:35.443391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:56635)
0923 14:44:35.443672 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:35.443737 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":85,"threads_started":1}
I20260923 14:44:35.579622 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:35.579194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:48319)
0923 14:44:35.579462 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:35.579521 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":77,"threads_started":1}
I20260923 14:44:35.770112 1968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:35.769705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:43657)
0923 14:44:35.769953 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:35.770014 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":85,"threads_started":1}
I20260923 14:44:36.445281 1969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:36.444886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.129:50597)
0923 14:44:36.445128 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:36.445186 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":72,"threads_started":1}
I20260923 14:44:36.580988 1970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:36.580513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.130:37869)
0923 14:44:36.580820 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:36.580886 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":119,"threads_started":1}
I20260923 14:44:36.764005 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 1476
I20260923 14:44:36.769908 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 1651
I20260923 14:44:36.772205 1971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:36.771811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:44699 (local address 127.17.4.131:36951)
0923 14:44:36.772050 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:36.772114 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.190:44699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":78,"threads_started":1}
I20260923 14:44:36.775920 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 1786
2026-09-23T14:44:36Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59383 ms)
[----------] 30 tests from SecurityITest (239894 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:36 dist-test-slave-54kg krb5kdc[1974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:36 dist-test-slave-54kg krb5kdc[1974](info): set up 2 sockets
Sep 23 14:44:36 dist-test-slave-54kg krb5kdc[1974](info): commencing operation
krb5kdc: starting...
W20260923 14:44:37.844877 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:37 dist-test-slave-54kg krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:44:37.963181 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:40877
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:40877
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:38.071408 1988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:38.071655 1988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:38.071695 1988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:38.075623 1988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:38.075675 1988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:38.075695 1988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:38.075711 1988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:38.075726 1988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:38.080775 1988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:40877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:40877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:38.081702 1988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:38.082633 1988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:38.091130 1993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.091238 1988 server_base.cc:1034] running on GCE node
W20260923 14:44:38.091169 1994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:38.091140 1996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.092018 1988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:38.093056 1988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:38.094216 1988 hybrid_clock.cc:648] HybridClock initialized: now 1790174678094203 us; error 24 us; skew 500 ppm
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:38.096930 1988 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:44:38.097757 1988 webserver.cc:460] Webserver started at http://127.17.4.190:38423/ using document root <none> and password file <none>
I20260923 14:44:38.098333 1988 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:38.098423 1988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:38.098650 1988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:38.100710 1988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "7864802fe4674e678ebfb60e520bad32"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "4aa3003ef7443f16b543da7e0754fcbd"
server_key_iv: "2b2cb76611571ac9d49270c1d4aa23d5"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.101297 1988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "7864802fe4674e678ebfb60e520bad32"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "4aa3003ef7443f16b543da7e0754fcbd"
server_key_iv: "2b2cb76611571ac9d49270c1d4aa23d5"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.105075 1988 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 14:44:38.107496 2003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.108806 1988 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:38.108950 1988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "7864802fe4674e678ebfb60e520bad32"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "4aa3003ef7443f16b543da7e0754fcbd"
server_key_iv: "2b2cb76611571ac9d49270c1d4aa23d5"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.109067 1988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:38.131428 1988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:38.134552 1988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:38.134783 1988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:38.141960 1988 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:40877
I20260923 14:44:38.141991 2055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:40877 every 8 connection(s)
I20260923 14:44:38.142890 1988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:38.145557 2056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:38.148844 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 1988
I20260923 14:44:38.148996 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:38.149289 17426 external_mini_cluster.cc:1428] Setting key 60892a14dd6e153c9f69f0542d7ed697
I20260923 14:44:38.151569 2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32: Bootstrap starting.
I20260923 14:44:38.153833 2056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:38.154573 2056 log.cc:824] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:38.156756 2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32: No bootstrap required, opened a new log
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:38.160650 2056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7864802fe4674e678ebfb60e520bad32" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40877 } }
I20260923 14:44:38.160868 2056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:38.160928 2056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7864802fe4674e678ebfb60e520bad32, State: Initialized, Role: FOLLOWER
I20260923 14:44:38.161413 2056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7864802fe4674e678ebfb60e520bad32" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40877 } }
I20260923 14:44:38.161568 2056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:38.161643 2056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:38.161759 2056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:38.162762 2056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7864802fe4674e678ebfb60e520bad32" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40877 } }
I20260923 14:44:38.163129 2056 leader_election.cc:302] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7864802fe4674e678ebfb60e520bad32; no voters:
I20260923 14:44:38.163453 2056 leader_election.cc:288] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:38.163563 2061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:38.163800 2061 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [term 1 LEADER]: Becoming Leader. State: Replica: 7864802fe4674e678ebfb60e520bad32, State: Running, Role: LEADER
I20260923 14:44:38.164168 2061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7864802fe4674e678ebfb60e520bad32" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40877 } }
I20260923 14:44:38.164499 2059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.150762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53232 (local address 127.17.4.190:40877)
0923 14:44:38.151204 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.151219 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.151254 (+ 35us) server_negotiation.cc:407] Connection header received
0923 14:44:38.152004 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.152028 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.152370 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.152715 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:38.153515 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.154587 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.155659 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.156204 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.156322 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.159121 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:38.159126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:38.159138 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:38.159164 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:38.161114 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.161573 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.161579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.161585 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.161761 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.162129 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.162132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.162133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.162532 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:38.162682 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.163050 (+ 368us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.163392 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":124,"threads_started":1}
I20260923 14:44:38.164748 2056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:38.165792 2063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7864802fe4674e678ebfb60e520bad32. Latest consensus state: current_term: 1 leader_uuid: "7864802fe4674e678ebfb60e520bad32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7864802fe4674e678ebfb60e520bad32" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40877 } } }
I20260923 14:44:38.165899 2062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7864802fe4674e678ebfb60e520bad32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7864802fe4674e678ebfb60e520bad32" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40877 } } }
I20260923 14:44:38.166028 2062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:38.166028 2063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:38.167001 2070 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:38.170375 2070 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:38.175836 2070 catalog_manager.cc:1347] Generated new cluster ID: 1612513e10a443c7b828e34fa4d81d78
I20260923 14:44:38.175901 2070 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:38.187001 2070 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:38.188179 2070 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:38.195736 2070 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32: Generated new TSK 0
I20260923 14:44:38.196552 2070 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:44:38.227928 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40877
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:38.338987 2083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:38.339229 2083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:38.339270 2083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:38.343276 2083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:38.343324 2083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:38.343381 2083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:38.348479 2083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:38.349409 2083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:38.350324 2083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:38.359659 2088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:38.359676 2089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:38.359692 2091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.359886 2083 server_base.cc:1034] running on GCE node
I20260923 14:44:38.360275 2083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:38.360838 2083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:38.361985 2083 hybrid_clock.cc:648] HybridClock initialized: now 1790174678361961 us; error 40 us; skew 500 ppm
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:38.364712 2083 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:44:38.365603 2083 webserver.cc:460] Webserver started at http://127.17.4.129:36579/ using document root <none> and password file <none>
I20260923 14:44:38.366190 2083 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:38.366250 2083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:38.366403 2083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:38.368485 2083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "937c61146da7473b9adebcb02bd02702"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "de5d062fed5bb5895a2ad1deb8e1a07f"
server_key_iv: "289315748843298f202dc8fa6309d851"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.369001 2083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "937c61146da7473b9adebcb02bd02702"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "de5d062fed5bb5895a2ad1deb8e1a07f"
server_key_iv: "289315748843298f202dc8fa6309d851"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.372725 2083 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 14:44:38.375020 2098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.376294 2083 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:38.376420 2083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "937c61146da7473b9adebcb02bd02702"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "de5d062fed5bb5895a2ad1deb8e1a07f"
server_key_iv: "289315748843298f202dc8fa6309d851"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.376523 2083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:38.402338 2083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:38.405463 2083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:38.405690 2083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:38.406308 2083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:38.407147 2083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:38.407193 2083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.407258 2083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:38.407287 2083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.416332 2083 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:45167
I20260923 14:44:38.416361 2211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:45167 every 8 connection(s)
I20260923 14:44:38.417223 2083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:38.424307 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2083
I20260923 14:44:38.424437 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:44:38.424790 17426 external_mini_cluster.cc:1428] Setting key f4772c05c7719fa37000fbf492cb8a55
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:38.431236 2059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.419028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:37587 (local address 127.17.4.190:40877)
0923 14:44:38.419183 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.419188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.420115 (+ 927us) server_negotiation.cc:407] Connection header received
0923 14:44:38.421483 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.421486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.421534 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.421608 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:38.422726 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.423265 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.424732 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.425010 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.425097 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.427820 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:38.427829 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:38.427831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:38.427853 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:38.429228 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.429737 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.429743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.429744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.429826 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.430170 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.430173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.430175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.430351 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:38.430457 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.430940 (+ 483us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.431065 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:44:38.432060 2215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.419455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40877 (local address 127.17.4.129:37587)
0923 14:44:38.419964 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:38.420007 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:38.421291 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:38.421745 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:38.421751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:38.422101 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:38.422585 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.422598 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.423368 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.423371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.424591 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.424604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.425166 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.425172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.425337 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.426001 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:38.426017 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:38.427640 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:38.429349 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:38.429354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:38.429368 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:38.429625 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:38.429920 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:38.429923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:38.429925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:38.430069 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:38.430454 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:38.430461 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:38.430707 (+ 246us) client_negotiation.cc:769] Sending connection context
0923 14:44:38.430888 (+ 181us) client_negotiation.cc:240] Negotiation successful
0923 14:44:38.431207 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":115,"threads_started":1}
I20260923 14:44:38.433264 2212 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40877
I20260923 14:44:38.433521 2212 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:38.434005 2212 heartbeater.cc:511] Master 127.17.4.190:40877 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:44:38.435497 2020 ts_manager.cc:194] Registered new tserver with Master: 937c61146da7473b9adebcb02bd02702 (127.17.4.129:45167)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:44:38.436843 2020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:37587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:44:38.450593 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40877
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:38.563072 2218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:38.563334 2218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:38.563376 2218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:38.567613 2218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:38.567677 2218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:38.567736 2218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:38.573014 2218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:38.574002 2218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:38.574954 2218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:38.584309 2223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.584434 2218 server_base.cc:1034] running on GCE node
W20260923 14:44:38.584362 2226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:38.584350 2224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.584903 2218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:38.585572 2218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:38.586797 2218 hybrid_clock.cc:648] HybridClock initialized: now 1790174678586780 us; error 48 us; skew 500 ppm
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:38.589543 2218 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:44:38.590305 2218 webserver.cc:460] Webserver started at http://127.17.4.130:43637/ using document root <none> and password file <none>
I20260923 14:44:38.590830 2218 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:38.590885 2218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:38.591040 2218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:38.593021 2218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "0406489eace5483bab22cfa9630fd01f"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "0a4ae0d33703b255c8fb1a72661e38ae"
server_key_iv: "241a9b9c220b38d581e5643ccb1a0356"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.593616 2218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "0406489eace5483bab22cfa9630fd01f"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "0a4ae0d33703b255c8fb1a72661e38ae"
server_key_iv: "241a9b9c220b38d581e5643ccb1a0356"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.597342 2218 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:38.599808 2233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.600996 2218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:38.601126 2218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "0406489eace5483bab22cfa9630fd01f"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "0a4ae0d33703b255c8fb1a72661e38ae"
server_key_iv: "241a9b9c220b38d581e5643ccb1a0356"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.601235 2218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:38.613528 2218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:38.616307 2218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:38.616508 2218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:38.617014 2218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:38.617738 2218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:38.617784 2218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.617821 2218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:38.617844 2218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.626757 2218 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:37893
I20260923 14:44:38.626789 2346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:37893 every 8 connection(s)
I20260923 14:44:38.627647 2218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:38.636971 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2218
I20260923 14:44:38.637099 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:44:38.637422 17426 external_mini_cluster.cc:1428] Setting key 2060caf91d29987fe2d130584c341284
I20260923 14:44:38.641184 2059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.629403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:43335 (local address 127.17.4.190:40877)
0923 14:44:38.629577 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.629582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.630398 (+ 816us) server_negotiation.cc:407] Connection header received
0923 14:44:38.631703 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.631705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.631755 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.631913 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:38.633032 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.633558 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.634675 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.634901 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.634982 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.637509 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:38.637513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:38.637515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:38.637541 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:38.639093 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.639636 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.639640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.639645 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.639726 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.640124 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.640128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.640131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.640307 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:38.640420 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.640896 (+ 476us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.641011 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 14:44:38.641937 2350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.629795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40877 (local address 127.17.4.130:43335)
0923 14:44:38.630248 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:38.630290 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:38.631506 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:38.632062 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:38.632068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:38.632441 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:38.632902 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.632914 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.633675 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.633677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.634554 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.634563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.635029 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.635031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.635181 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.635838 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:38.635864 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:38.637352 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:38.639243 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:38.639249 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:38.639263 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:38.639519 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:38.639859 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:38.639862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:38.639864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:38.640014 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:38.640419 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:38.640426 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:38.640669 (+ 243us) client_negotiation.cc:769] Sending connection context
0923 14:44:38.640853 (+ 184us) client_negotiation.cc:240] Negotiation successful
0923 14:44:38.641158 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":119,"threads_started":1}
I20260923 14:44:38.643184 2348 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40877
I20260923 14:44:38.643443 2348 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:38.643975 2348 heartbeater.cc:511] Master 127.17.4.190:40877 requested a full tablet report, sending...
I20260923 14:44:38.645083 2020 ts_manager.cc:194] Registered new tserver with Master: 0406489eace5483bab22cfa9630fd01f (127.17.4.130:37893)
I20260923 14:44:38.645654 2020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:43335
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:44:38.666875 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40877
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:38.774416 2353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:38.774709 2353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:38.774785 2353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:38.778808 2353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:38.778890 2353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:38.778978 2353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:38.784231 2353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:38.785223 2353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:38.786195 2353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:38.795657 2359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:38.795686 2358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.795707 2353 server_base.cc:1034] running on GCE node
W20260923 14:44:38.795657 2361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:38.796336 2353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:38.796902 2353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:38.798084 2353 hybrid_clock.cc:648] HybridClock initialized: now 1790174678798070 us; error 25 us; skew 500 ppm
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:38.800922 2353 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:44:38.801796 2353 webserver.cc:460] Webserver started at http://127.17.4.131:46877/ using document root <none> and password file <none>
I20260923 14:44:38.802352 2353 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:38.802438 2353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:38.802678 2353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:38.804736 2353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "a64714f8b64ed911cbefacc3c6f11875"
server_key_iv: "f320952984169f76080ab7bff9f8826e"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.805279 2353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "a64714f8b64ed911cbefacc3c6f11875"
server_key_iv: "f320952984169f76080ab7bff9f8826e"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.808813 2353 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:38.811064 2368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.812345 2353 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:38.812475 2353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786"
format_stamp: "Formatted at 2026-09-23 14:44:38 on dist-test-slave-54kg"
server_key: "a64714f8b64ed911cbefacc3c6f11875"
server_key_iv: "f320952984169f76080ab7bff9f8826e"
server_key_version: "encryptionkey@0"
I20260923 14:44:38.812585 2353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:38.838670 2353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:38.841985 2353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:38.842199 2353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:38.842783 2353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:38.843612 2353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:38.843683 2353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.843761 2353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:38.843828 2353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:38.852846 2353 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:45535
I20260923 14:44:38.852881 2481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:45535 every 8 connection(s)
I20260923 14:44:38.853709 2353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:38.862845 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2353
Sep 23 14:44:38 dist-test-slave-54kg krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:38.862978 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:44:38.863255 17426 external_mini_cluster.cc:1428] Setting key 8c6d3ed29c64f33be1c586e9ecdb325f
I20260923 14:44:38.867384 2059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.855504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:42035 (local address 127.17.4.190:40877)
0923 14:44:38.855668 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.855671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.856479 (+ 808us) server_negotiation.cc:407] Connection header received
0923 14:44:38.857790 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.857794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.857854 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.857954 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:38.859046 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.859585 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.860780 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.860992 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.861126 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.863514 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:38.863521 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:38.863527 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:38.863557 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:38.865168 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.865849 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.865856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.865859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.865949 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.866309 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.866312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.866314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.866503 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:38.866608 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.867102 (+ 494us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.867226 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 14:44:38.868196 2484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.855852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40877 (local address 127.17.4.131:42035)
0923 14:44:38.856319 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:38.856359 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:38.857588 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:38.858128 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:38.858134 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:38.858465 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:38.858908 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.858920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.859705 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.859715 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.860644 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.860653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.861165 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.861169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.861332 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.861861 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:38.861876 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:38.863352 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:38.865287 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:38.865293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:38.865307 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:38.865740 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:38.866049 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:38.866055 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:38.866057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:38.866220 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:38.866606 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:38.866612 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:38.866874 (+ 262us) client_negotiation.cc:769] Sending connection context
0923 14:44:38.867050 (+ 176us) client_negotiation.cc:240] Negotiation successful
0923 14:44:38.867348 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":132,"threads_started":1}
I20260923 14:44:38.869192 2482 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40877
I20260923 14:44:38.869417 2482 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:38.869881 2482 heartbeater.cc:511] Master 127.17.4.190:40877 requested a full tablet report, sending...
I20260923 14:44:38.870855 2020 ts_manager.cc:194] Registered new tserver with Master: 1e8cc8b00b4c42d2a2246e2eabb0f786 (127.17.4.131:45535)
I20260923 14:44:38.871553 2020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:42035
I20260923 14:44:38.877175 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:38.886031 2059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.879152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53236 (local address 127.17.4.190:40877)
0923 14:44:38.879285 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.879292 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.879404 (+ 112us) server_negotiation.cc:407] Connection header received
0923 14:44:38.879490 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.879492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.879528 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.879590 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:38.880397 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.880938 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.881765 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.881996 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.882063 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.883393 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:38.883396 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:38.883398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:38.883415 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:38.884668 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.885041 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.885043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.885045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.885127 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:38.885351 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:38.885353 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:38.885354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:38.885540 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:38.885636 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.885799 (+ 163us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.885878 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:44:38.888893 2020 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:38.891835 2020 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:38.905560 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.899794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:37893 (local address 127.0.0.1:40108)
0923 14:44:38.900679 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:38.900692 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:38.900771 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:38.901379 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:38.901384 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:38.901405 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:38.901542 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.901549 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.903090 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.903093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.904218 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.904227 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.905022 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.905025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.905102 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.905182 (+ 80us) client_negotiation.cc:769] Sending connection context
0923 14:44:38.905288 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 14:44:38.905398 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":34,"thread_start_us":98,"threads_started":1}
I20260923 14:44:38.905764 2495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.899872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.17.4.131:45535)
0923 14:44:38.901253 (+ 1381us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.901266 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.901288 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:44:38.901358 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.901362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.901516 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.901691 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:38.901932 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.902661 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.904339 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.905153 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.905302 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.905481 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.905531 (+ 50us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.905619 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1292,"thread_start_us":121,"threads_started":1}
I20260923 14:44:38.906055 2496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.899729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45535 (local address 127.0.0.1:33598)
0923 14:44:38.900553 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:38.900604 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:38.900735 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:38.901684 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:38.901687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:38.901704 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:38.901815 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.901822 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.902782 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.902788 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.904174 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.904185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.905306 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.905309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.905398 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.905418 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 14:44:38.905476 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 14:44:38.905526 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":103,"threads_started":1}
I20260923 14:44:38.906476 2494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.900064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:45167 (local address 127.0.0.1:37518)
0923 14:44:38.900961 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:38.900972 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:38.901039 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:38.901559 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:38.901561 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:38.901598 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:38.901705 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.901711 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.903090 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.903093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.904867 (+ 1774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:38.904878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.906057 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.906059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:38.906165 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.906197 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 14:44:38.906259 (+ 62us) client_negotiation.cc:240] Negotiation successful
0923 14:44:38.906322 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":26,"thread_start_us":81,"threads_started":1}
I20260923 14:44:38.906497 2498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.900505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40108 (local address 127.17.4.130:37893)
0923 14:44:38.900876 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.900889 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.900911 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:44:38.900990 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.900998 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.901218 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.901367 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:38.901697 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.902914 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.904328 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.904858 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.905912 (+ 1054us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.906054 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.906105 (+ 51us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.906219 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":93,"threads_started":1}
I20260923 14:44:38.907310 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:38.900345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37518 (local address 127.17.4.129:45167)
0923 14:44:38.901024 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:38.901041 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:38.901060 (+ 19us) server_negotiation.cc:407] Connection header received
0923 14:44:38.901118 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:38.901123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:38.901259 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:38.901414 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:38.901824 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.902929 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.905006 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:38.905763 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:38.905874 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:38.906004 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:38.907110 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0923 14:44:38.907198 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":80,"threads_started":1}
I20260923 14:44:38.909030 2416 tablet_service.cc:1467] Processing CreateTablet for tablet 20854dbfe92b40cbb2e35311fc6727ab (DEFAULT_TABLE table=test-table [id=acdd06f894dc4a18839fd446d123b9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:38.909175 2281 tablet_service.cc:1467] Processing CreateTablet for tablet 20854dbfe92b40cbb2e35311fc6727ab (DEFAULT_TABLE table=test-table [id=acdd06f894dc4a18839fd446d123b9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:38.909307 2146 tablet_service.cc:1467] Processing CreateTablet for tablet 20854dbfe92b40cbb2e35311fc6727ab (DEFAULT_TABLE table=test-table [id=acdd06f894dc4a18839fd446d123b9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:38.910112 2281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20854dbfe92b40cbb2e35311fc6727ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:38.910135 2416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20854dbfe92b40cbb2e35311fc6727ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:38.910068 2146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20854dbfe92b40cbb2e35311fc6727ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:38.916875 2499 tablet_bootstrap.cc:492] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702: Bootstrap starting.
I20260923 14:44:38.917886 2500 tablet_bootstrap.cc:492] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Bootstrap starting.
I20260923 14:44:38.919485 2499 tablet_bootstrap.cc:654] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:38.919633 2500 tablet_bootstrap.cc:654] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:38.920115 2501 tablet_bootstrap.cc:492] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Bootstrap starting.
I20260923 14:44:38.920841 2499 log.cc:824] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:38.920878 2500 log.cc:824] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:38.922595 2501 tablet_bootstrap.cc:654] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:38.922638 2499 tablet_bootstrap.cc:492] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702: No bootstrap required, opened a new log
I20260923 14:44:38.922839 2499 ts_tablet_manager.cc:1397] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:44:38.922896 2500 tablet_bootstrap.cc:492] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: No bootstrap required, opened a new log
I20260923 14:44:38.923069 2500 ts_tablet_manager.cc:1397] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:44:38.923389 2501 log.cc:824] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:38.925338 2501 tablet_bootstrap.cc:492] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: No bootstrap required, opened a new log
I20260923 14:44:38.925526 2501 ts_tablet_manager.cc:1397] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:44:38.926364 2499 raft_consensus.cc:348] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:38.926589 2499 raft_consensus.cc:374] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:38.926671 2499 raft_consensus.cc:729] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937c61146da7473b9adebcb02bd02702, State: Initialized, Role: FOLLOWER
I20260923 14:44:38.926746 2500 raft_consensus.cc:348] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:38.926992 2500 raft_consensus.cc:374] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:38.927044 2500 raft_consensus.cc:729] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8cc8b00b4c42d2a2246e2eabb0f786, State: Initialized, Role: FOLLOWER
I20260923 14:44:38.927135 2499 consensus_queue.cc:260] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:38.927446 2500 consensus_queue.cc:260] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:38.928265 2499 ts_tablet_manager.cc:1428] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:44:38.928395 2500 ts_tablet_manager.cc:1428] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:44:38.928642 2212 heartbeater.cc:503] Master 127.17.4.190:40877 was elected leader, sending a full tablet report...
I20260923 14:44:38.928707 2482 heartbeater.cc:503] Master 127.17.4.190:40877 was elected leader, sending a full tablet report...
I20260923 14:44:38.929158 2501 raft_consensus.cc:348] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:38.929332 2501 raft_consensus.cc:374] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:38.929363 2501 raft_consensus.cc:729] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0406489eace5483bab22cfa9630fd01f, State: Initialized, Role: FOLLOWER
I20260923 14:44:38.929817 2501 consensus_queue.cc:260] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:38.930467 2348 heartbeater.cc:503] Master 127.17.4.190:40877 was elected leader, sending a full tablet report...
I20260923 14:44:38.930739 2501 ts_tablet_manager.cc:1428] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:44:39.060365 2507 raft_consensus.cc:482] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:39.060627 2507 raft_consensus.cc:504] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:39.061841 2507 leader_election.cc:288] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e8cc8b00b4c42d2a2246e2eabb0f786 (127.17.4.131:45535), 937c61146da7473b9adebcb02bd02702 (127.17.4.129:45167)
I20260923 14:44:39.065552 2495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.062264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:52863 (local address 127.17.4.131:45535)
0923 14:44:39.062386 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.062390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.062406 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:44:39.062491 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.062494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.062553 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.062637 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:39.062925 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.063434 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.064529 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.064944 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.065081 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.065159 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.065350 (+ 191us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.065456 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:44:39.065550 2350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.062140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:45535 (local address 127.17.4.130:52863)
0923 14:44:39.062273 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:39.062289 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:39.062389 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:39.062672 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:39.062675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:39.062693 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:39.062808 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.062813 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.063550 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.063555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.064403 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.064412 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.065081 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.065085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.065226 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.065244 (+ 18us) client_negotiation.cc:769] Sending connection context
0923 14:44:39.065334 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 14:44:39.065401 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260923 14:44:39.066021 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.062198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:47731 (local address 127.17.4.129:45167)
0923 14:44:39.062327 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.062334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.062735 (+ 401us) server_negotiation.cc:407] Connection header received
0923 14:44:39.062893 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.062896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.062941 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.063024 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:39.063310 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.063842 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.064865 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.065468 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.065596 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.065643 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.065833 (+ 190us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.065902 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:39.066321 2436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20854dbfe92b40cbb2e35311fc6727ab" candidate_uuid: "0406489eace5483bab22cfa9630fd01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" is_pre_election: true
I20260923 14:44:39.066390 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.062147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:45167 (local address 127.17.4.130:47731)
0923 14:44:39.062628 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:39.062640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:39.062771 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:39.063036 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:39.063039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:39.063054 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:39.063195 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.063201 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.063956 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.063960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.064735 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.064743 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.065591 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.065595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.065695 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.065719 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 14:44:39.066215 (+ 496us) client_negotiation.cc:240] Negotiation successful
0923 14:44:39.066292 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":119,"thread_start_us":155,"threads_started":1}
I20260923 14:44:39.066625 2436 raft_consensus.cc:2454] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0406489eace5483bab22cfa9630fd01f in term 0.
I20260923 14:44:39.067088 2166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20854dbfe92b40cbb2e35311fc6727ab" candidate_uuid: "0406489eace5483bab22cfa9630fd01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937c61146da7473b9adebcb02bd02702" is_pre_election: true
I20260923 14:44:39.067152 2235 leader_election.cc:302] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0406489eace5483bab22cfa9630fd01f, 1e8cc8b00b4c42d2a2246e2eabb0f786; no voters:
I20260923 14:44:39.067353 2166 raft_consensus.cc:2454] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0406489eace5483bab22cfa9630fd01f in term 0.
I20260923 14:44:39.067447 2507 raft_consensus.cc:2781] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:39.067533 2507 raft_consensus.cc:482] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:39.067584 2507 raft_consensus.cc:3037] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:39.068651 2507 raft_consensus.cc:504] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:39.069036 2507 leader_election.cc:288] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [CANDIDATE]: Term 1 election: Requested vote from peers 1e8cc8b00b4c42d2a2246e2eabb0f786 (127.17.4.131:45535), 937c61146da7473b9adebcb02bd02702 (127.17.4.129:45167)
I20260923 14:44:39.069404 2436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20854dbfe92b40cbb2e35311fc6727ab" candidate_uuid: "0406489eace5483bab22cfa9630fd01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786"
I20260923 14:44:39.069417 2166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20854dbfe92b40cbb2e35311fc6727ab" candidate_uuid: "0406489eace5483bab22cfa9630fd01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937c61146da7473b9adebcb02bd02702"
I20260923 14:44:39.069522 2436 raft_consensus.cc:3037] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:39.069522 2166 raft_consensus.cc:3037] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:39.070770 2166 raft_consensus.cc:2454] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0406489eace5483bab22cfa9630fd01f in term 1.
I20260923 14:44:39.070770 2436 raft_consensus.cc:2454] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0406489eace5483bab22cfa9630fd01f in term 1.
I20260923 14:44:39.071074 2234 leader_election.cc:302] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0406489eace5483bab22cfa9630fd01f, 937c61146da7473b9adebcb02bd02702; no voters:
I20260923 14:44:39.071276 2507 raft_consensus.cc:2781] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:39.071488 2507 raft_consensus.cc:686] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 1 LEADER]: Becoming Leader. State: Replica: 0406489eace5483bab22cfa9630fd01f, State: Running, Role: LEADER
I20260923 14:44:39.071837 2507 consensus_queue.cc:237] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } }
I20260923 14:44:39.074879 2018 catalog_manager.cc:5495] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0406489eace5483bab22cfa9630fd01f (127.17.4.130). New cstate: current_term: 1 leader_uuid: "0406489eace5483bab22cfa9630fd01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0406489eace5483bab22cfa9630fd01f" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 37893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260923 14:44:39.092326 2498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.088762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40112 (local address 127.17.4.130:37893)
0923 14:44:39.088888 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.088894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.088907 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:44:39.089083 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.089085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.089135 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.089242 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:39.089483 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.089963 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.090795 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.091007 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.091115 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.091442 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:39.091944 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:39.092062 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.092118 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.092170 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:39.097808 2436 raft_consensus.cc:1261] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 1 FOLLOWER]: Refusing update from remote peer 0406489eace5483bab22cfa9630fd01f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:39.097980 2166 raft_consensus.cc:1261] T 20854dbfe92b40cbb2e35311fc6727ab P 937c61146da7473b9adebcb02bd02702 [term 1 FOLLOWER]: Refusing update from remote peer 0406489eace5483bab22cfa9630fd01f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:39.098572 2507 consensus_queue.cc:1035] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "937c61146da7473b9adebcb02bd02702" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:39.098798 2509 consensus_queue.cc:1035] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8cc8b00b4c42d2a2246e2eabb0f786" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 14:44:39.104761 2483 tablet.cc:2369] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:39.106881 2514 mvcc.cc:205] Tried to move back new op lower bound from 7332555485577805824 to 7332555485480931328. Current Snapshot: MvccSnapshot[applied={T|T < 7332555485577805824}]
I20260923 14:44:39.114530 2018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:39.114687 2018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:39.117215 2018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7864802fe4674e678ebfb60e520bad32: Sending DeleteTablet for 3 replicas of tablet 20854dbfe92b40cbb2e35311fc6727ab
I20260923 14:44:39.118016 2416 tablet_service.cc:1514] Processing DeleteTablet for tablet 20854dbfe92b40cbb2e35311fc6727ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:39 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:33598
I20260923 14:44:39.117993 2281 tablet_service.cc:1514] Processing DeleteTablet for tablet 20854dbfe92b40cbb2e35311fc6727ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:39 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:40108
I20260923 14:44:39.118538 2522 tablet_replica.cc:330] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: stopping tablet replica
I20260923 14:44:39.118790 2146 tablet_service.cc:1514] Processing DeleteTablet for tablet 20854dbfe92b40cbb2e35311fc6727ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:39 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:37518
I20260923 14:44:39.118916 2522 raft_consensus.cc:2229] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:39.119236 2522 raft_consensus.cc:2258] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:39.119400 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2083
I20260923 14:44:39.119603 2523 tablet_replica.cc:330] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: stopping tablet replica
I20260923 14:44:39.119891 2523 raft_consensus.cc:2229] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:44:39.120225 2523 raft_consensus.cc:2258] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:39.120869 2522 ts_tablet_manager.cc:1905] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:39.121507 2523 ts_tablet_manager.cc:1905] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:39.124125 2522 ts_tablet_manager.cc:1918] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:39.124222 2523 ts_tablet_manager.cc:1918] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:39.124259 2522 log.cc:1196] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/20854dbfe92b40cbb2e35311fc6727ab
I20260923 14:44:39.124349 2523 log.cc:1196] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/20854dbfe92b40cbb2e35311fc6727ab
I20260923 14:44:39.124599 2522 ts_tablet_manager.cc:1939] T 20854dbfe92b40cbb2e35311fc6727ab P 1e8cc8b00b4c42d2a2246e2eabb0f786: Deleting consensus metadata
I20260923 14:44:39.124684 2523 ts_tablet_manager.cc:1939] T 20854dbfe92b40cbb2e35311fc6727ab P 0406489eace5483bab22cfa9630fd01f: Deleting consensus metadata
I20260923 14:44:39.125861 2007 catalog_manager.cc:4841] TS 0406489eace5483bab22cfa9630fd01f (127.17.4.130:37893): tablet 20854dbfe92b40cbb2e35311fc6727ab (table test-table [id=acdd06f894dc4a18839fd446d123b9b4]) successfully deleted
I20260923 14:44:39.126044 2005 catalog_manager.cc:4841] TS 1e8cc8b00b4c42d2a2246e2eabb0f786 (127.17.4.131:45535): tablet 20854dbfe92b40cbb2e35311fc6727ab (table test-table [id=acdd06f894dc4a18839fd446d123b9b4]) successfully deleted
W20260923 14:44:39.129637 2004 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:45167 (error 108)
I20260923 14:44:39.129834 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2218
I20260923 14:44:39.135638 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2353
I20260923 14:44:39.137383 2496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.136969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:45167 (local address 127.0.0.1:37530)
0923 14:44:39.137188 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:39.137276 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:45167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260923 14:44:39.137562 2004 catalog_manager.cc:4584] TS 937c61146da7473b9adebcb02bd02702 (127.17.4.129:45167): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 20854dbfe92b40cbb2e35311fc6727ab: Network error: Client connection negotiation failed: client connection to 127.17.4.129:45167: connect: Connection refused (error 111)
I20260923 14:44:39.141503 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 1988
2026-09-23T14:44:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2365 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-23T14:44:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:39Z Disabled control of system clock
I20260923 14:44:39.171710 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:40879
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:40879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 14:44:39.280686 2529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:39.280954 2529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:39.280992 2529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:39.285033 2529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:39.285099 2529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:39.285116 2529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:39.285133 2529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:39.285148 2529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:39.290055 2529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:40879
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:40879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:39.291172 2529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:39.292655 2529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:39.301168 2535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.301366 2529 server_base.cc:1034] running on GCE node
W20260923 14:44:39.301198 2534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:39.301185 2537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.302088 2529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:39.303208 2529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:39.304400 2529 hybrid_clock.cc:648] HybridClock initialized: now 1790174679304383 us; error 33 us; skew 500 ppm
I20260923 14:44:39.306293 2529 webserver.cc:460] Webserver started at http://127.17.4.190:38731/ using document root <none> and password file <none>
I20260923 14:44:39.306871 2529 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:39.306963 2529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:39.307204 2529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:39.309329 2529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "21661b101b1b4f9ebf7ab59cd3d61175"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "612055a4e06764a3a59a44d551b74cd2"
server_key_iv: "61fa79043e38ba741fe1911dce04d211"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.309881 2529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "21661b101b1b4f9ebf7ab59cd3d61175"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "612055a4e06764a3a59a44d551b74cd2"
server_key_iv: "61fa79043e38ba741fe1911dce04d211"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.313463 2529 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:39.315750 2543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.316989 2529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:39.317123 2529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "21661b101b1b4f9ebf7ab59cd3d61175"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "612055a4e06764a3a59a44d551b74cd2"
server_key_iv: "61fa79043e38ba741fe1911dce04d211"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.317251 2529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:39.338124 2529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:39.338850 2529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:39.339053 2529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:39.345975 2529 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:40879
I20260923 14:44:39.345984 2596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:40879 every 8 connection(s)
I20260923 14:44:39.346944 2529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:39.347343 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2529
I20260923 14:44:39.347473 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:39.347798 17426 external_mini_cluster.cc:1428] Setting key 4b0a7f8eca4d4e898fb06eff7b9d66f8
I20260923 14:44:39.350327 2597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:39.356680 2597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175: Bootstrap starting.
I20260923 14:44:39.356983 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.349233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40084 (local address 127.17.4.190:40879)
0923 14:44:39.349839 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.349855 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.349888 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:44:39.350599 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.350616 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.350982 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.351282 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:39.351612 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.352633 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.353817 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.354272 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.354389 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.355228 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:39.355233 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:39.355244 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:39.355612 (+ 368us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:39.355665 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:39.355683 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:39.355801 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.355958 (+ 157us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.356263 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":137,"threads_started":1}
I20260923 14:44:39.359225 2597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:39.360024 2597 log.cc:824] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:39.361809 2597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175: No bootstrap required, opened a new log
I20260923 14:44:39.365499 2597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40879 } }
I20260923 14:44:39.365711 2597 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:39.365795 2597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21661b101b1b4f9ebf7ab59cd3d61175, State: Initialized, Role: FOLLOWER
I20260923 14:44:39.366182 2597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40879 } }
I20260923 14:44:39.366321 2597 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:39.366385 2597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:39.366505 2597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:39.367383 2597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40879 } }
I20260923 14:44:39.367719 2597 leader_election.cc:302] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21661b101b1b4f9ebf7ab59cd3d61175; no voters:
I20260923 14:44:39.368068 2597 leader_election.cc:288] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:39.368253 2602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:39.368553 2602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [term 1 LEADER]: Becoming Leader. State: Replica: 21661b101b1b4f9ebf7ab59cd3d61175, State: Running, Role: LEADER
I20260923 14:44:39.368851 2602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40879 } }
I20260923 14:44:39.369436 2597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:39.370463 2604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21661b101b1b4f9ebf7ab59cd3d61175. Latest consensus state: current_term: 1 leader_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40879 } } }
I20260923 14:44:39.370625 2604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:39.370960 2603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21661b101b1b4f9ebf7ab59cd3d61175" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 40879 } } }
I20260923 14:44:39.371052 2603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:39.371024 2611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:39.374428 2611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:39.380395 2611 catalog_manager.cc:1347] Generated new cluster ID: 0f27cf037f684ce3b8457cc9ca7655ec
I20260923 14:44:39.380466 2611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:39.385782 2611 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:39.386847 2611 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:39.400180 2611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175: Generated new TSK 0
I20260923 14:44:39.401144 2611 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:39.408454 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40879
--builtin_ntp_servers=127.17.4.148:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 14:44:39.519883 2621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:39.520171 2621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:39.520233 2621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:39.524456 2621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:39.524501 2621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:39.524555 2621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:39.529304 2621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:39.530311 2621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:39.531635 2621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:39.541103 2627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:39.541121 2626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.541227 2621 server_base.cc:1034] running on GCE node
W20260923 14:44:39.541121 2629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.541899 2621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:39.542454 2621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:39.543644 2621 hybrid_clock.cc:648] HybridClock initialized: now 1790174679543630 us; error 25 us; skew 500 ppm
I20260923 14:44:39.545468 2621 webserver.cc:460] Webserver started at http://127.17.4.129:46785/ using document root <none> and password file <none>
I20260923 14:44:39.545985 2621 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:39.546041 2621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:39.546197 2621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:39.548202 2621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "2a05ba6315304bff8047851d0bdcfda9"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "b0b8a81e8dfb68225164ca182605bdac"
server_key_iv: "ccd4d58bb5283d2add7e81bdc09f1854"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.548710 2621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "2a05ba6315304bff8047851d0bdcfda9"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "b0b8a81e8dfb68225164ca182605bdac"
server_key_iv: "ccd4d58bb5283d2add7e81bdc09f1854"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.552169 2621 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:39.554440 2635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.555591 2621 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:39.555718 2621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "2a05ba6315304bff8047851d0bdcfda9"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "b0b8a81e8dfb68225164ca182605bdac"
server_key_iv: "ccd4d58bb5283d2add7e81bdc09f1854"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.555886 2621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:39.581537 2621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:39.582209 2621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:39.582417 2621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:39.583004 2621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:39.583990 2621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:39.584038 2621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.584079 2621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:39.584127 2621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.593138 2621 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:44233
I20260923 14:44:39.593165 2750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:44233 every 8 connection(s)
I20260923 14:44:39.594018 2621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:39.594789 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2621
I20260923 14:44:39.594898 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:44:39.595245 17426 external_mini_cluster.cc:1428] Setting key 9a928234a7d142087b4ee0320c2f9786
I20260923 14:44:39.597414 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40879
--builtin_ntp_servers=127.17.4.148:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 14:44:39.604660 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.595914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:47741 (local address 127.17.4.190:40879)
0923 14:44:39.596063 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.596067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.597254 (+ 1187us) server_negotiation.cc:407] Connection header received
0923 14:44:39.598839 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.598842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.598888 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.598957 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:39.600112 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.600635 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.602473 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.602687 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.602764 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.604169 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:39.604172 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:39.604174 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:39.604186 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:39.604205 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:39.604213 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:39.604271 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.604475 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.604543 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:44:39.605929 2753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.596414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40879 (local address 127.17.4.129:47741)
0923 14:44:39.597118 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:39.597159 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:39.598601 (+ 1442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:39.599143 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:39.599153 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:39.599275 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:39.599976 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.599993 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.600780 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.600787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.602346 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.602361 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.602857 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.602864 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.603118 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.603825 (+ 707us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:39.603829 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:39.603890 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:39.603984 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:39.604304 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:39.604316 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:39.604325 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 14:44:39.604461 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 14:44:39.604798 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":124,"threads_started":1}
I20260923 14:44:39.607266 2751 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40879
I20260923 14:44:39.607492 2751 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:39.608040 2751 heartbeater.cc:511] Master 127.17.4.190:40879 requested a full tablet report, sending...
I20260923 14:44:39.609582 2560 ts_manager.cc:194] Registered new tserver with Master: 2a05ba6315304bff8047851d0bdcfda9 (127.17.4.129:44233)
I20260923 14:44:39.610812 2560 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.129:47741
W20260923 14:44:39.712455 2754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:39.712762 2754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:39.712836 2754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:39.716709 2754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:39.716790 2754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:39.716879 2754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:39.721539 2754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:39.722595 2754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:39.723965 2754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:39.733045 2759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:39.733279 2760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:39.733103 2762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.733419 2754 server_base.cc:1034] running on GCE node
I20260923 14:44:39.733806 2754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:39.734373 2754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:39.735564 2754 hybrid_clock.cc:648] HybridClock initialized: now 1790174679735529 us; error 26 us; skew 500 ppm
I20260923 14:44:39.737402 2754 webserver.cc:460] Webserver started at http://127.17.4.130:33171/ using document root <none> and password file <none>
I20260923 14:44:39.737952 2754 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:39.738044 2754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:39.738298 2754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:39.740285 2754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "ae4cbb0599ab4aba8223eae054af910e"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "20accfe69deffbfb1c4621acd718bcc8"
server_key_iv: "6904ff0dafa9a73d463b170b58522623"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.740835 2754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "ae4cbb0599ab4aba8223eae054af910e"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "20accfe69deffbfb1c4621acd718bcc8"
server_key_iv: "6904ff0dafa9a73d463b170b58522623"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.744261 2754 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:39.746429 2768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.747586 2754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:39.747725 2754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "ae4cbb0599ab4aba8223eae054af910e"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "20accfe69deffbfb1c4621acd718bcc8"
server_key_iv: "6904ff0dafa9a73d463b170b58522623"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.747882 2754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:39.762748 2754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:39.763360 2754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:39.763533 2754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:39.764139 2754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:39.764998 2754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:39.765090 2754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.765162 2754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:39.765210 2754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.773962 2754 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:44073
I20260923 14:44:39.774016 2882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:44073 every 8 connection(s)
I20260923 14:44:39.774811 2754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:44:39.783478 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.776610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:60505 (local address 127.17.4.190:40879)
0923 14:44:39.776780 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.776784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.777804 (+ 1020us) server_negotiation.cc:407] Connection header received
0923 14:44:39.779140 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.779143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.779189 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.779262 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:39.780194 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.780749 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.781814 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.782022 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.782097 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.783059 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:39.783062 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:39.783064 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:39.783076 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:39.783095 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:39.783103 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:39.783177 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.783311 (+ 134us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.783362 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 14:44:39.784224 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2754
I20260923 14:44:39.784358 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:44:39.784406 2885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.777028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40879 (local address 127.17.4.130:60505)
0923 14:44:39.777667 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:39.777704 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:39.778935 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:39.779417 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:39.779423 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:39.779517 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:39.780037 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.780049 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.780853 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.780855 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.781710 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.781718 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.782153 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.782155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.782284 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.782822 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:39.782823 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:39.782862 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:39.782920 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:39.783191 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:39.783198 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:39.783202 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:44:39.783290 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 14:44:39.783494 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
I20260923 14:44:39.784708 17426 external_mini_cluster.cc:1428] Setting key 0a86e5ccb7c5d1d1366c0b86fd3296e2
I20260923 14:44:39.785575 2883 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40879
I20260923 14:44:39.785810 2883 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:39.786302 2883 heartbeater.cc:511] Master 127.17.4.190:40879 requested a full tablet report, sending...
I20260923 14:44:39.786652 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40879
--builtin_ntp_servers=127.17.4.148:35839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 14:44:39.787312 2560 ts_manager.cc:194] Registered new tserver with Master: ae4cbb0599ab4aba8223eae054af910e (127.17.4.130:44073)
I20260923 14:44:39.788141 2560 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.130:60505
W20260923 14:44:39.897444 2886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:39.897675 2886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:39.897710 2886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:39.901947 2886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:39.902017 2886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:39.902098 2886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:39.906775 2886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:40879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:39.907799 2886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:39.909128 2886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:39.918211 2891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:39.918256 2894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.918370 2886 server_base.cc:1034] running on GCE node
W20260923 14:44:39.918210 2892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:39.918944 2886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:39.919530 2886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:39.920706 2886 hybrid_clock.cc:648] HybridClock initialized: now 1790174679920676 us; error 52 us; skew 500 ppm
I20260923 14:44:39.922551 2886 webserver.cc:460] Webserver started at http://127.17.4.131:45173/ using document root <none> and password file <none>
I20260923 14:44:39.923147 2886 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:39.923236 2886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:39.923435 2886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:39.925465 2886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "9decad37114a4a029bd4100292266a0c"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "5b6898a3eab067876297a8ff3df1cae6"
server_key_iv: "a2ff42b1d72ec3b573eff506e2713146"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.926000 2886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "9decad37114a4a029bd4100292266a0c"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "5b6898a3eab067876297a8ff3df1cae6"
server_key_iv: "a2ff42b1d72ec3b573eff506e2713146"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.929582 2886 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:39.931800 2900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.932957 2886 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:39.933084 2886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "9decad37114a4a029bd4100292266a0c"
format_stamp: "Formatted at 2026-09-23 14:44:39 on dist-test-slave-54kg"
server_key: "5b6898a3eab067876297a8ff3df1cae6"
server_key_iv: "a2ff42b1d72ec3b573eff506e2713146"
server_key_version: "encryptionkey@0"
I20260923 14:44:39.933210 2886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:39.957270 2886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:39.957882 2886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:39.958074 2886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:39.958602 2886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:39.959522 2886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:39.959585 2886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.959666 2886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:39.959715 2886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:39.968669 2886 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:46011
I20260923 14:44:39.968698 3014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:46011 every 8 connection(s)
I20260923 14:44:39.969573 2886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:39.973577 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 2886
I20260923 14:44:39.973657 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:44:39.973922 17426 external_mini_cluster.cc:1428] Setting key 7142b289c09a4dad48bd82d517dbe0cc
I20260923 14:44:39.978768 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.971452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:40467 (local address 127.17.4.190:40879)
0923 14:44:39.971622 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.971631 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.972668 (+ 1037us) server_negotiation.cc:407] Connection header received
0923 14:44:39.974126 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.974130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.974186 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.974268 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:39.975126 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.975674 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.976894 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.977119 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.977226 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.978288 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:39.978291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:39.978294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:39.978306 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:39.978328 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:39.978341 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:39.978412 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.978568 (+ 156us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.978633 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:44:39.979532 3017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.971947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:40879 (local address 127.17.4.131:40467)
0923 14:44:39.972545 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:39.972583 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:39.973892 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:39.974445 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:39.974451 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:39.974531 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:39.974986 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.974998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.975832 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.975836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.976770 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:39.976779 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.977271 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.977274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:39.977428 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.978035 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:39.978036 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:39.978078 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:39.978141 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:39.978426 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:39.978438 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:39.978444 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 14:44:39.978567 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 14:44:39.978823 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260923 14:44:39.980491 3015 heartbeater.cc:347] Connected to a master server at 127.17.4.190:40879
I20260923 14:44:39.980724 3015 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:39.981228 3015 heartbeater.cc:511] Master 127.17.4.190:40879 requested a full tablet report, sending...
I20260923 14:44:39.982141 2560 ts_manager.cc:194] Registered new tserver with Master: 9decad37114a4a029bd4100292266a0c (127.17.4.131:46011)
I20260923 14:44:39.982682 2560 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.131:40467
I20260923 14:44:39.987514 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:39.993084 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:39.989376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.17.4.190:40879)
0923 14:44:39.989459 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:39.989462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:39.989710 (+ 248us) server_negotiation.cc:407] Connection header received
0923 14:44:39.989835 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:39.989843 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:39.989877 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:39.989956 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:39.990223 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.990690 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.991510 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:39.991738 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:39.991895 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:39.992686 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:39.992689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:39.992692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:39.992704 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:39.992729 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:39.992737 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:39.992810 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:39.992901 (+ 91us) server_negotiation.cc:299] Negotiation successful
0923 14:44:39.992948 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260923 14:44:39.995551 2560 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:39.998514 2560 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:40.012223 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.006600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:44073 (local address 127.0.0.1:38062)
0923 14:44:40.007220 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:40.007234 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:40.007312 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:40.008248 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:40.008251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:40.008272 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:40.008356 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.008361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.009784 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.009787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.010889 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.010897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.011786 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.011790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.011878 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.011904 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 14:44:40.011976 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 14:44:40.012052 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":96,"threads_started":1}
I20260923 14:44:40.012251 3030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.007220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.17.4.130:44073)
0923 14:44:40.007630 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:40.007648 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:40.007673 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:44:40.007750 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:40.007755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:40.007945 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:40.008089 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:40.008475 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.009656 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.010992 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.011632 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.011731 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.011938 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:40.011997 (+ 59us) server_negotiation.cc:299] Negotiation successful
0923 14:44:40.012088 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":92,"threads_started":1}
I20260923 14:44:40.012365 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.006602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37330 (local address 127.17.4.129:44233)
0923 14:44:40.007396 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:40.007411 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:40.007435 (+ 24us) server_negotiation.cc:407] Connection header received
0923 14:44:40.007511 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:40.007516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:40.007734 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:40.007928 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:40.008223 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.009188 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.010631 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.011401 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.011503 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.011681 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:40.012118 (+ 437us) server_negotiation.cc:299] Negotiation successful
0923 14:44:40.012209 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":112,"threads_started":1}
I20260923 14:44:40.012635 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.006413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:44233 (local address 127.0.0.1:37330)
0923 14:44:40.006906 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:40.006951 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:40.007075 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:40.007912 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:40.007918 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:40.007942 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:40.008089 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.008096 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.009289 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.009295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.010492 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.010501 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.011525 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.011529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.011646 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.011702 (+ 56us) client_negotiation.cc:769] Sending connection context
0923 14:44:40.011870 (+ 168us) client_negotiation.cc:240] Negotiation successful
0923 14:44:40.011990 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":73,"threads_started":1}
I20260923 14:44:40.013019 3031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.007490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40118 (local address 127.17.4.131:46011)
0923 14:44:40.007809 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:40.007820 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:40.008296 (+ 476us) server_negotiation.cc:407] Connection header received
0923 14:44:40.008379 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:40.008382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:40.008559 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:40.008702 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:40.008903 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.009914 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.011177 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.011942 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.012036 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.012194 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:40.012783 (+ 589us) server_negotiation.cc:299] Negotiation successful
0923 14:44:40.012876 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":99,"threads_started":1}
I20260923 14:44:40.012687 3029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.007071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:46011 (local address 127.0.0.1:40118)
0923 14:44:40.008166 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:40.008179 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:40.008266 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:40.008697 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:40.008699 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:40.008717 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:40.008789 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.008794 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.010017 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.010023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.011057 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.011066 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.012257 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.012261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.012366 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.012396 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 14:44:40.012469 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 14:44:40.012536 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1032,"thread_start_us":99,"threads_started":1}
I20260923 14:44:40.015465 2949 tablet_service.cc:1467] Processing CreateTablet for tablet e14b0dba7ed943608f6e899d9e8bbd60 (DEFAULT_TABLE table=test-table [id=77d5073a33de4bf9aee9cc90ab5c25e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:40.015534 2817 tablet_service.cc:1467] Processing CreateTablet for tablet e14b0dba7ed943608f6e899d9e8bbd60 (DEFAULT_TABLE table=test-table [id=77d5073a33de4bf9aee9cc90ab5c25e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:40.015599 2685 tablet_service.cc:1467] Processing CreateTablet for tablet e14b0dba7ed943608f6e899d9e8bbd60 (DEFAULT_TABLE table=test-table [id=77d5073a33de4bf9aee9cc90ab5c25e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:40.016463 2949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14b0dba7ed943608f6e899d9e8bbd60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:40.016556 2685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14b0dba7ed943608f6e899d9e8bbd60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:40.016556 2817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14b0dba7ed943608f6e899d9e8bbd60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:40.023712 3034 tablet_bootstrap.cc:492] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Bootstrap starting.
I20260923 14:44:40.024098 3032 tablet_bootstrap.cc:492] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Bootstrap starting.
I20260923 14:44:40.026125 3034 tablet_bootstrap.cc:654] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:40.026160 3032 tablet_bootstrap.cc:654] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:40.026548 3033 tablet_bootstrap.cc:492] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: Bootstrap starting.
I20260923 14:44:40.027015 3032 log.cc:824] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:40.027015 3034 log.cc:824] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:40.028780 3033 tablet_bootstrap.cc:654] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:40.029254 3032 tablet_bootstrap.cc:492] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: No bootstrap required, opened a new log
I20260923 14:44:40.029320 3034 tablet_bootstrap.cc:492] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: No bootstrap required, opened a new log
I20260923 14:44:40.029470 3032 ts_tablet_manager.cc:1397] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:44:40.029508 3034 ts_tablet_manager.cc:1397] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:44:40.029604 3033 log.cc:824] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:40.031594 3033 tablet_bootstrap.cc:492] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: No bootstrap required, opened a new log
I20260923 14:44:40.031802 3033 ts_tablet_manager.cc:1397] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:44:40.032940 3032 raft_consensus.cc:348] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.033170 3032 raft_consensus.cc:374] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:40.033241 3032 raft_consensus.cc:729] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9decad37114a4a029bd4100292266a0c, State: Initialized, Role: FOLLOWER
I20260923 14:44:40.033685 3032 consensus_queue.cc:260] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.033710 3034 raft_consensus.cc:348] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.033962 3034 raft_consensus.cc:374] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:40.034058 3034 raft_consensus.cc:729] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4cbb0599ab4aba8223eae054af910e, State: Initialized, Role: FOLLOWER
I20260923 14:44:40.034427 3015 heartbeater.cc:503] Master 127.17.4.190:40879 was elected leader, sending a full tablet report...
I20260923 14:44:40.034646 3032 ts_tablet_manager.cc:1428] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 14:44:40.034693 3034 consensus_queue.cc:260] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.035585 3034 ts_tablet_manager.cc:1428] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 14:44:40.035995 2883 heartbeater.cc:503] Master 127.17.4.190:40879 was elected leader, sending a full tablet report...
I20260923 14:44:40.035897 3033 raft_consensus.cc:348] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.036142 3033 raft_consensus.cc:374] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:40.036211 3033 raft_consensus.cc:729] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a05ba6315304bff8047851d0bdcfda9, State: Initialized, Role: FOLLOWER
I20260923 14:44:40.036597 3033 consensus_queue.cc:260] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.037284 2751 heartbeater.cc:503] Master 127.17.4.190:40879 was elected leader, sending a full tablet report...
I20260923 14:44:40.037477 3033 ts_tablet_manager.cc:1428] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:44:40.058081 3038 raft_consensus.cc:482] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:40.058238 3038 raft_consensus.cc:504] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.059221 3038 leader_election.cc:288] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a05ba6315304bff8047851d0bdcfda9 (127.17.4.129:44233), ae4cbb0599ab4aba8223eae054af910e (127.17.4.130:44073)
I20260923 14:44:40.063644 3030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.059634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:43253 (local address 127.17.4.130:44073)
0923 14:44:40.059779 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:40.059784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:40.059976 (+ 192us) server_negotiation.cc:407] Connection header received
0923 14:44:40.060052 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:40.060054 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:40.060121 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:40.060197 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:40.060472 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.061165 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.062505 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.063089 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.063190 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.063236 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:40.063446 (+ 210us) server_negotiation.cc:299] Negotiation successful
0923 14:44:40.063518 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:40.063643 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.059454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:53337 (local address 127.17.4.129:44233)
0923 14:44:40.059612 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:40.059619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:40.059637 (+ 18us) server_negotiation.cc:407] Connection header received
0923 14:44:40.059687 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:40.059690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:40.059743 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:40.059854 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:40.060134 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.060933 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.062378 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.063012 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.063154 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.063203 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:40.063446 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 14:44:40.063519 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:44:40.063670 3017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.059391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:44233 (local address 127.17.4.131:53337)
0923 14:44:40.059496 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:40.059514 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:40.059597 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:40.059862 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:40.059866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:40.059885 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:40.060020 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.060031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.061038 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.061040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.062249 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.062259 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.063124 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.063126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.063258 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.063331 (+ 73us) client_negotiation.cc:769] Sending connection context
0923 14:44:40.063412 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 14:44:40.063517 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":27}
I20260923 14:44:40.064003 3041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.059450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:44073 (local address 127.17.4.131:43253)
0923 14:44:40.059875 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:40.059887 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:40.059974 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:40.060212 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:40.060214 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:40.060228 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:40.060363 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.060368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.061256 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.061259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.062379 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:40.062386 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.063184 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.063187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:40.063331 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.063348 (+ 17us) client_negotiation.cc:769] Sending connection context
0923 14:44:40.063412 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 14:44:40.063517 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":77,"thread_start_us":144,"threads_started":1}
I20260923 14:44:40.064324 2705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e14b0dba7ed943608f6e899d9e8bbd60" candidate_uuid: "9decad37114a4a029bd4100292266a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a05ba6315304bff8047851d0bdcfda9" is_pre_election: true
I20260923 14:44:40.064616 2705 raft_consensus.cc:2454] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9decad37114a4a029bd4100292266a0c in term 0.
I20260923 14:44:40.064669 2837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e14b0dba7ed943608f6e899d9e8bbd60" candidate_uuid: "9decad37114a4a029bd4100292266a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4cbb0599ab4aba8223eae054af910e" is_pre_election: true
I20260923 14:44:40.064936 2837 raft_consensus.cc:2454] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9decad37114a4a029bd4100292266a0c in term 0.
I20260923 14:44:40.065104 2902 leader_election.cc:302] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a05ba6315304bff8047851d0bdcfda9, 9decad37114a4a029bd4100292266a0c; no voters:
I20260923 14:44:40.065372 3038 raft_consensus.cc:2781] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:40.065480 3038 raft_consensus.cc:482] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:40.065559 3038 raft_consensus.cc:3037] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:40.066653 3038 raft_consensus.cc:504] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.066952 3038 leader_election.cc:288] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [CANDIDATE]: Term 1 election: Requested vote from peers 2a05ba6315304bff8047851d0bdcfda9 (127.17.4.129:44233), ae4cbb0599ab4aba8223eae054af910e (127.17.4.130:44073)
I20260923 14:44:40.067276 2837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e14b0dba7ed943608f6e899d9e8bbd60" candidate_uuid: "9decad37114a4a029bd4100292266a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4cbb0599ab4aba8223eae054af910e"
I20260923 14:44:40.067276 2705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e14b0dba7ed943608f6e899d9e8bbd60" candidate_uuid: "9decad37114a4a029bd4100292266a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a05ba6315304bff8047851d0bdcfda9"
I20260923 14:44:40.067395 2837 raft_consensus.cc:3037] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:40.067492 2705 raft_consensus.cc:3037] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:40.068658 2837 raft_consensus.cc:2454] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9decad37114a4a029bd4100292266a0c in term 1.
I20260923 14:44:40.068658 2705 raft_consensus.cc:2454] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9decad37114a4a029bd4100292266a0c in term 1.
I20260923 14:44:40.068936 2904 leader_election.cc:302] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9decad37114a4a029bd4100292266a0c, ae4cbb0599ab4aba8223eae054af910e; no voters:
I20260923 14:44:40.069087 3038 raft_consensus.cc:2781] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:40.069290 3038 raft_consensus.cc:686] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 1 LEADER]: Becoming Leader. State: Replica: 9decad37114a4a029bd4100292266a0c, State: Running, Role: LEADER
I20260923 14:44:40.069626 3038 consensus_queue.cc:237] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } }
I20260923 14:44:40.072487 2558 catalog_manager.cc:5495] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9decad37114a4a029bd4100292266a0c (127.17.4.131). New cstate: current_term: 1 leader_uuid: "9decad37114a4a029bd4100292266a0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9decad37114a4a029bd4100292266a0c" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 46011 } health_report { overall_health: HEALTHY } } }
I20260923 14:44:40.088738 3031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.085632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40128 (local address 127.17.4.131:46011)
0923 14:44:40.085770 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:40.085773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:40.085786 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:44:40.085918 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:40.085920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:40.085968 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:40.086052 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:40.086240 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.086722 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.087496 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:40.087700 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:40.087839 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:40.088073 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:40.088430 (+ 357us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:40.088517 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:40.088580 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 14:44:40.088628 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 14:44:40.094005 2837 raft_consensus.cc:1261] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 1 FOLLOWER]: Refusing update from remote peer 9decad37114a4a029bd4100292266a0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:40.094005 2705 raft_consensus.cc:1261] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 1 FOLLOWER]: Refusing update from remote peer 9decad37114a4a029bd4100292266a0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:40.094663 3038 consensus_queue.cc:1035] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a05ba6315304bff8047851d0bdcfda9" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 44233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:40.094846 3042 consensus_queue.cc:1035] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4cbb0599ab4aba8223eae054af910e" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 44073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 14:44:40.095149 2752 tablet.cc:2369] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:40.102895 3046 mvcc.cc:205] Tried to move back new op lower bound from 7332555489658564608 to 7332555489567674368. Current Snapshot: MvccSnapshot[applied={T|T < 7332555489658564608}]
I20260923 14:44:40.110064 2558 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:40.110248 2558 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:40.112557 2558 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21661b101b1b4f9ebf7ab59cd3d61175: Sending DeleteTablet for 3 replicas of tablet e14b0dba7ed943608f6e899d9e8bbd60
I20260923 14:44:40.113240 2685 tablet_service.cc:1514] Processing DeleteTablet for tablet e14b0dba7ed943608f6e899d9e8bbd60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:40 UTC) from {username='slave'} at 127.0.0.1:37330
I20260923 14:44:40.113431 2817 tablet_service.cc:1514] Processing DeleteTablet for tablet e14b0dba7ed943608f6e899d9e8bbd60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:40 UTC) from {username='slave'} at 127.0.0.1:38062
I20260923 14:44:40.113517 2949 tablet_service.cc:1514] Processing DeleteTablet for tablet e14b0dba7ed943608f6e899d9e8bbd60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:40 UTC) from {username='slave'} at 127.0.0.1:40118
I20260923 14:44:40.113662 3055 tablet_replica.cc:330] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9: stopping tablet replica
I20260923 14:44:40.113946 3055 raft_consensus.cc:2229] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:40.114262 3055 raft_consensus.cc:2258] T e14b0dba7ed943608f6e899d9e8bbd60 P 2a05ba6315304bff8047851d0bdcfda9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:40.114274 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2621
I20260923 14:44:40.115839 3057 tablet_replica.cc:330] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: stopping tablet replica
I20260923 14:44:40.116113 3057 raft_consensus.cc:2229] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:44:40.116503 3057 raft_consensus.cc:2258] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:40.116861 3056 tablet_replica.cc:330] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: stopping tablet replica
I20260923 14:44:40.117115 3056 raft_consensus.cc:2229] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:40.117376 3056 raft_consensus.cc:2258] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:40.118024 3057 ts_tablet_manager.cc:1905] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:40.118523 3056 ts_tablet_manager.cc:1905] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:40.120803 3056 ts_tablet_manager.cc:1918] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:40.120908 3056 log.cc:1196] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/e14b0dba7ed943608f6e899d9e8bbd60
I20260923 14:44:40.121219 3056 ts_tablet_manager.cc:1939] T e14b0dba7ed943608f6e899d9e8bbd60 P ae4cbb0599ab4aba8223eae054af910e: Deleting consensus metadata
I20260923 14:44:40.121361 3057 ts_tablet_manager.cc:1918] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:40.121486 3057 log.cc:1196] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/e14b0dba7ed943608f6e899d9e8bbd60
I20260923 14:44:40.121795 3057 ts_tablet_manager.cc:1939] T e14b0dba7ed943608f6e899d9e8bbd60 P 9decad37114a4a029bd4100292266a0c: Deleting consensus metadata
I20260923 14:44:40.122538 2547 catalog_manager.cc:4841] TS ae4cbb0599ab4aba8223eae054af910e (127.17.4.130:44073): tablet e14b0dba7ed943608f6e899d9e8bbd60 (table test-table [id=77d5073a33de4bf9aee9cc90ab5c25e7]) successfully deleted
W20260923 14:44:40.122622 2545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:44233 (error 108)
I20260923 14:44:40.122773 2547 catalog_manager.cc:4841] TS 9decad37114a4a029bd4100292266a0c (127.17.4.131:46011): tablet e14b0dba7ed943608f6e899d9e8bbd60 (table test-table [id=77d5073a33de4bf9aee9cc90ab5c25e7]) successfully deleted
I20260923 14:44:40.122866 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2754
I20260923 14:44:40.128650 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:40.128357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:44233 (local address 127.0.0.1:37344)
0923 14:44:40.128492 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:40.128571 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:44233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 14:44:40.128813 2545 catalog_manager.cc:4584] TS 2a05ba6315304bff8047851d0bdcfda9 (127.17.4.129:44233): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e14b0dba7ed943608f6e899d9e8bbd60: Network error: Client connection negotiation failed: client connection to 127.17.4.129:44233: connect: Connection refused (error 111)
I20260923 14:44:40.130460 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2886
I20260923 14:44:40.136726 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 2529
2026-09-23T14:44:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (994 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:40 dist-test-slave-54kg krb5kdc[3061](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:40 dist-test-slave-54kg krb5kdc[3061](info): set up 2 sockets
Sep 23 14:44:40 dist-test-slave-54kg krb5kdc[3061](info): commencing operation
krb5kdc: starting...
W20260923 14:44:41.164786 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:44:41.287703 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34917
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:34917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:41.397055 3074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:41.397344 3074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:41.397418 3074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:41.402658 3074 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:41.402748 3074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:41.402786 3074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:41.402822 3074 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:41.402855 3074 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:41.408260 3074 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:34917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:34917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:41.409323 3074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:41.410346 3074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:41.418695 3082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:41.418695 3080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:41.418691 3079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:41.418942 3074 server_base.cc:1034] running on GCE node
I20260923 14:44:41.419473 3074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:41.420586 3074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:41.421764 3074 hybrid_clock.cc:648] HybridClock initialized: now 1790174681421747 us; error 32 us; skew 500 ppm
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:41.424546 3074 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:44:41.425467 3074 webserver.cc:460] Webserver started at http://127.17.4.190:39351/ using document root <none> and password file <none>
I20260923 14:44:41.426017 3074 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:41.426077 3074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:41.426306 3074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:41.428447 3074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "107a94c8692c2475ac6ac63b2a40850f"
server_key_iv: "03be2abd1751d10599ff8f52215d4f35"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.429008 3074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "107a94c8692c2475ac6ac63b2a40850f"
server_key_iv: "03be2abd1751d10599ff8f52215d4f35"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.432796 3074 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 14:44:41.435149 3089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.436484 3074 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:41.436625 3074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "107a94c8692c2475ac6ac63b2a40850f"
server_key_iv: "03be2abd1751d10599ff8f52215d4f35"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.436738 3074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:41.453651 3074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:41.456684 3074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:41.456898 3074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:41.463950 3074 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:34917
I20260923 14:44:41.463970 3141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:34917 every 8 connection(s)
I20260923 14:44:41.464906 3074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:41.467635 3142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:41.473186 3142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: Bootstrap starting.
I20260923 14:44:41.473625 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3074
I20260923 14:44:41.473759 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:41.474047 17426 external_mini_cluster.cc:1428] Setting key 3a50bee243060e5f8640ec11006aaf25
I20260923 14:44:41.475986 3142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:41.476744 3142 log.cc:824] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:41.478825 3142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: No bootstrap required, opened a new log
I20260923 14:44:41.482934 3142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34917 } }
I20260923 14:44:41.483176 3142 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:41.483266 3142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b0c60bbcdb40ad8192d4bfff3d5ff5, State: Initialized, Role: FOLLOWER
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:41.483829 3142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34917 } }
I20260923 14:44:41.483987 3142 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:41.484055 3142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:41.484153 3142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:41.485276 3142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34917 } }
I20260923 14:44:41.485651 3142 leader_election.cc:302] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56b0c60bbcdb40ad8192d4bfff3d5ff5; no voters:
I20260923 14:44:41.485984 3142 leader_election.cc:288] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:41.486112 3147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:41.486327 3147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [term 1 LEADER]: Becoming Leader. State: Replica: 56b0c60bbcdb40ad8192d4bfff3d5ff5, State: Running, Role: LEADER
I20260923 14:44:41.487160 3147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34917 } }
I20260923 14:44:41.487257 3142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:41.488977 3149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34917 } } }
I20260923 14:44:41.489126 3149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:41.489524 3148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56b0c60bbcdb40ad8192d4bfff3d5ff5. Latest consensus state: current_term: 1 leader_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b0c60bbcdb40ad8192d4bfff3d5ff5" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 34917 } } }
I20260923 14:44:41.490113 3148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:41.490449 3145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:41.475370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51864 (local address 127.17.4.190:34917)
0923 14:44:41.475808 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:41.475830 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:41.475874 (+ 44us) server_negotiation.cc:407] Connection header received
0923 14:44:41.476555 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:41.476572 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:41.476950 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:41.477233 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:41.478034 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.479497 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.480478 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.481175 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.481347 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:41.484354 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:41.484359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:41.484372 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:41.484401 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:41.486418 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:41.486920 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:41.486926 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:41.486931 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:41.487070 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:41.487411 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:41.487415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:41.487417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:41.487967 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:41.488151 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:41.489121 (+ 970us) server_negotiation.cc:299] Negotiation successful
0923 14:44:41.489439 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":137,"threads_started":1}
W20260923 14:44:41.492969 3162 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:44:41.493057 3162 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:44:41.493139 3161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:41.494040 3161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:41.499562 3161 catalog_manager.cc:1347] Generated new cluster ID: 946291acebfb435f8c005a972f32fadc
I20260923 14:44:41.499635 3161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:41.513437 3161 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:41.514673 3161 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:41.521378 3161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: Generated new TSK 0
I20260923 14:44:41.522141 3161 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:44:41.552523 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34917
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:41.665426 3169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:41.665715 3169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:41.665789 3169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:41.669835 3169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:41.669916 3169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:41.670006 3169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:41.675181 3169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:41.676313 3169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:41.677346 3169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:41.687244 3175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:41.687250 3174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:41.687316 3169 server_base.cc:1034] running on GCE node
W20260923 14:44:41.687269 3177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:41.687996 3169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:41.688791 3169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:41.689988 3169 hybrid_clock.cc:648] HybridClock initialized: now 1790174681689974 us; error 33 us; skew 500 ppm
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:41.692785 3169 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:44:41.693687 3169 webserver.cc:460] Webserver started at http://127.17.4.129:41093/ using document root <none> and password file <none>
I20260923 14:44:41.694250 3169 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:41.694341 3169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:41.694576 3169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:41.696676 3169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "3a14dba8fb0c41e59672777fc91975dd"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "2edf29c73dbb829feeff37b62d4b16ad"
server_key_iv: "a0e1885ebdc63d049a4cffde8dae37cd"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.697223 3169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "3a14dba8fb0c41e59672777fc91975dd"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "2edf29c73dbb829feeff37b62d4b16ad"
server_key_iv: "a0e1885ebdc63d049a4cffde8dae37cd"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.700807 3169 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:41.703043 3184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.704243 3169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:41.704375 3169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "3a14dba8fb0c41e59672777fc91975dd"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "2edf29c73dbb829feeff37b62d4b16ad"
server_key_iv: "a0e1885ebdc63d049a4cffde8dae37cd"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.704485 3169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:41.718039 3169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:41.720834 3169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:41.721029 3169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:41.721601 3169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:41.722388 3169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:41.722460 3169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.722532 3169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:41.722575 3169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.731690 3169 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:42293
I20260923 14:44:41.731707 3298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:42293 every 8 connection(s)
I20260923 14:44:41.732628 3169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:41.738766 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3169
I20260923 14:44:41.738888 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:44:41.739189 17426 external_mini_cluster.cc:1428] Setting key 04f503ed1791a8b5c4d51d9c07613c87
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:41.746688 3145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:41.734367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:39023 (local address 127.17.4.190:34917)
0923 14:44:41.734531 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:41.734537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:41.735336 (+ 799us) server_negotiation.cc:407] Connection header received
0923 14:44:41.736660 (+ 1324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:41.736663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:41.736712 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:41.736789 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:41.737909 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.738456 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.739887 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.740139 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.740257 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:41.743065 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:41.743069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:41.743074 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:41.743103 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:41.744590 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:41.745123 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:41.745126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:41.745128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:41.745208 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:41.745564 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:41.745567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:41.745569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:41.745755 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:41.745872 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:41.746388 (+ 516us) server_negotiation.cc:299] Negotiation successful
0923 14:44:41.746526 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 14:44:41.747488 3301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:41.734754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34917 (local address 127.17.4.129:39023)
0923 14:44:41.735186 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:41.735229 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:41.736453 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:41.736946 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:41.736952 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:41.737319 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:41.737783 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:41.737796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.738596 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.738602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:41.739730 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:41.739745 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.740299 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.740303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:41.740519 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:41.741183 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:41.741199 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:41.742903 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:41.744725 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:41.744730 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:41.744746 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:41.745004 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:41.745300 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:41.745305 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:41.745307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:41.745459 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:41.745871 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:41.745877 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:41.746134 (+ 257us) client_negotiation.cc:769] Sending connection context
0923 14:44:41.746321 (+ 187us) client_negotiation.cc:240] Negotiation successful
0923 14:44:41.746682 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":98,"threads_started":1}
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
I20260923 14:44:41.748876 3299 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34917
I20260923 14:44:41.749131 3299 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:41.749665 3299 heartbeater.cc:511] Master 127.17.4.190:34917 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
I20260923 14:44:41.751201 3106 ts_manager.cc:194] Registered new tserver with Master: 3a14dba8fb0c41e59672777fc91975dd (127.17.4.129:42293)
I20260923 14:44:41.752425 3106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:39023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:44:41.766240 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34917
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:41.875092 3304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:41.875360 3304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:41.875403 3304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:41.879426 3304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:41.879482 3304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:41.879576 3304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:41.884711 3304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:41.885730 3304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:41.886699 3304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:41.896025 3309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:41.896044 3310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:41.896306 3312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:41.896345 3304 server_base.cc:1034] running on GCE node
I20260923 14:44:41.896718 3304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:41.897310 3304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:41.898459 3304 hybrid_clock.cc:648] HybridClock initialized: now 1790174681898447 us; error 25 us; skew 500 ppm
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:41.904676 3304 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:44:41.905475 3304 webserver.cc:460] Webserver started at http://127.17.4.130:46863/ using document root <none> and password file <none>
I20260923 14:44:41.905979 3304 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:41.906035 3304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:41.906194 3304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:41.908247 3304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "790f4efa33a24ea7b160ea57e1223e7c"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "24fe74a6301aedca06ad54c6ee728596"
server_key_iv: "a76d724f94c5f73f20b14c77c96ac7cf"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.908747 3304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "790f4efa33a24ea7b160ea57e1223e7c"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "24fe74a6301aedca06ad54c6ee728596"
server_key_iv: "a76d724f94c5f73f20b14c77c96ac7cf"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.912335 3304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260923 14:44:41.914566 3319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.915730 3304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:41.915894 3304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "790f4efa33a24ea7b160ea57e1223e7c"
format_stamp: "Formatted at 2026-09-23 14:44:41 on dist-test-slave-54kg"
server_key: "24fe74a6301aedca06ad54c6ee728596"
server_key_iv: "a76d724f94c5f73f20b14c77c96ac7cf"
server_key_version: "encryptionkey@0"
I20260923 14:44:41.916002 3304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:41.927278 3304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:41.930498 3304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:41.930732 3304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:41.931304 3304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:41.932255 3304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:41.932327 3304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.932399 3304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:41.932451 3304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:41.941212 3304 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:41969
I20260923 14:44:41.941238 3432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:41969 every 8 connection(s)
I20260923 14:44:41.942137 3304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
Sep 23 14:44:41 dist-test-slave-54kg krb5kdc[3061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174681, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:41.952041 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3304
I20260923 14:44:41.952191 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:44:41.952589 17426 external_mini_cluster.cc:1428] Setting key 0ed45e8c1a30c7e02c877eecc458afbc
I20260923 14:44:41.955832 3145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:41.943872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:60721 (local address 127.17.4.190:34917)
0923 14:44:41.944004 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:41.944008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:41.944814 (+ 806us) server_negotiation.cc:407] Connection header received
0923 14:44:41.946192 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:41.946195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:41.946251 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:41.946353 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:41.947473 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.948080 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.949207 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.949431 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.949540 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:41.951983 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:41.951986 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:41.951988 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:41.952011 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:41.953647 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:41.954255 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:41.954259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:41.954261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:41.954348 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:41.954690 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:41.954693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:41.954695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:41.954884 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:41.955015 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:41.955497 (+ 482us) server_negotiation.cc:299] Negotiation successful
0923 14:44:41.955631 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:41.956702 3435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:41.944261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34917 (local address 127.17.4.130:60721)
0923 14:44:41.944672 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:41.944713 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:41.945974 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:41.946523 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:41.946529 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:41.946874 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:41.947333 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:41.947346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.948202 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.948206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:41.949083 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:41.949092 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:41.949583 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:41.949586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:41.949749 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:41.950373 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:41.950388 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:41.951805 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:41.953778 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:41.953783 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:41.953794 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:41.954149 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:41.954439 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:41.954443 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:41.954445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:41.954590 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:41.955014 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:41.955022 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:41.955259 (+ 237us) client_negotiation.cc:769] Sending connection context
0923 14:44:41.955459 (+ 200us) client_negotiation.cc:240] Negotiation successful
0923 14:44:41.955820 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":96,"threads_started":1}
I20260923 14:44:41.957937 3433 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34917
I20260923 14:44:41.958173 3433 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:41.958655 3433 heartbeater.cc:511] Master 127.17.4.190:34917 requested a full tablet report, sending...
I20260923 14:44:41.959733 3106 ts_manager.cc:194] Registered new tserver with Master: 790f4efa33a24ea7b160ea57e1223e7c (127.17.4.130:41969)
I20260923 14:44:41.960358 3106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:60721
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:44:41.979171 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34917
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:42.087085 3438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:42.087363 3438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:42.087440 3438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:42.091611 3438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:42.091703 3438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:42.091835 3438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:42.097187 3438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:34917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:42.098300 3438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:42.099349 3438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:42.109321 3446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:42.109316 3443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:42.109320 3444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:42.109552 3438 server_base.cc:1034] running on GCE node
I20260923 14:44:42.110060 3438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:42.110677 3438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:42.111835 3438 hybrid_clock.cc:648] HybridClock initialized: now 1790174682111823 us; error 35 us; skew 500 ppm
Sep 23 14:44:42 dist-test-slave-54kg krb5kdc[3061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174682, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:42.114601 3438 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:44:42.115530 3438 webserver.cc:460] Webserver started at http://127.17.4.131:34617/ using document root <none> and password file <none>
I20260923 14:44:42.116160 3438 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:42.116252 3438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:42.116453 3438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:42.118480 3438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "4d2e125d79874a91b19e7f747967cb50"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "5b4103eeded0f46fa4b36c7c36f3d669"
server_key_iv: "a9c357f9ae54b451fda000c134951938"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.119058 3438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "4d2e125d79874a91b19e7f747967cb50"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "5b4103eeded0f46fa4b36c7c36f3d669"
server_key_iv: "a9c357f9ae54b451fda000c134951938"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.122678 3438 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:44:42.125175 3453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.126379 3438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:42.126504 3438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "4d2e125d79874a91b19e7f747967cb50"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "5b4103eeded0f46fa4b36c7c36f3d669"
server_key_iv: "a9c357f9ae54b451fda000c134951938"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.126605 3438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:42.142999 3438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:42.145884 3438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:42.146096 3438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:42.146653 3438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:42.147424 3438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:42.147470 3438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.147552 3438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:42.147589 3438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.156459 3438 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:36133
I20260923 14:44:42.156484 3566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:36133 every 8 connection(s)
I20260923 14:44:42.157362 3438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:42.164875 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3438
I20260923 14:44:42.164981 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:44:42.165263 17426 external_mini_cluster.cc:1428] Setting key 716b29c4f4fade458e9946561cd9fc43
Sep 23 14:44:42 dist-test-slave-54kg krb5kdc[3061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174682, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:42.171845 3145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.159194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:34549 (local address 127.17.4.190:34917)
0923 14:44:42.159344 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.159348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.160167 (+ 819us) server_negotiation.cc:407] Connection header received
0923 14:44:42.161431 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.161434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.161482 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.161558 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:42.162684 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.163234 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.165660 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.165959 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.166107 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.168726 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:42.168729 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:42.168731 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:42.168755 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:42.170017 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:42.170470 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:42.170473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:42.170474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:42.170545 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:42.170860 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:42.170862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:42.170863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:42.171026 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:42.171097 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.171555 (+ 458us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.171664 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 14:44:42.172609 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.159551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:34917 (local address 127.17.4.131:34549)
0923 14:44:42.160012 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.160054 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.161225 (+ 1171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.161723 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.161729 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.162063 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:42.162510 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.162522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.163349 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.163351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.165513 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.165524 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.166152 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.166154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.166371 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.167006 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:42.167021 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:42.168576 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:42.170122 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:42.170126 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:42.170137 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:42.170377 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:42.170621 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:42.170623 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:42.170624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:42.170747 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:42.171131 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:42.171135 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:42.171348 (+ 213us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.171492 (+ 144us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.171741 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":149,"threads_started":1}
I20260923 14:44:42.173609 3567 heartbeater.cc:347] Connected to a master server at 127.17.4.190:34917
I20260923 14:44:42.173835 3567 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:42.174294 3567 heartbeater.cc:511] Master 127.17.4.190:34917 requested a full tablet report, sending...
I20260923 14:44:42.175238 3106 ts_manager.cc:194] Registered new tserver with Master: 4d2e125d79874a91b19e7f747967cb50 (127.17.4.131:36133)
I20260923 14:44:42.175845 3106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:34549
I20260923 14:44:42.178948 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:42.187884 3145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.180878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51870 (local address 127.17.4.190:34917)
0923 14:44:42.180999 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.181002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.181146 (+ 144us) server_negotiation.cc:407] Connection header received
0923 14:44:42.181256 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.181258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.181290 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.181354 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:42.181977 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.182478 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.183261 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.183463 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.183540 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.185047 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:42.185050 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:42.185052 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:42.185099 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:42.186306 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:42.186755 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:42.186757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:42.186758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:42.186829 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:42.187125 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:42.187127 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:42.187128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:42.187294 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:42.187397 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.187569 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.187690 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:44:42.190507 3106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51870:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:42.193557 3106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:42.208421 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.202115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:36133 (local address 127.0.0.1:53490)
0923 14:44:42.202478 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.202531 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.202650 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.203670 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.203676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.203700 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:42.203859 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.203866 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.205066 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.205071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.206576 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.206588 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.207691 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.207694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.207839 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.207926 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.208112 (+ 186us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.208246 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":32,"thread_start_us":68,"threads_started":1}
I20260923 14:44:42.208423 3580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.202213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53490 (local address 127.17.4.131:36133)
0923 14:44:42.203134 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.203173 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.203198 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:44:42.203279 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.203284 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.203492 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.204017 (+ 525us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:42.204188 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.204898 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.206700 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.207543 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.207679 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.207866 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.208148 (+ 282us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.208253 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":160,"threads_started":1}
I20260923 14:44:42.208545 3581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.202644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.17.4.129:42293)
0923 14:44:42.202982 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.202994 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.203511 (+ 517us) server_negotiation.cc:407] Connection header received
0923 14:44:42.203611 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.203619 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.203833 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.204006 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:42.204248 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.205066 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.206810 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.207569 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.207679 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.208249 (+ 570us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.208294 (+ 45us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.208378 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":134,"threads_started":1}
I20260923 14:44:42.209205 3579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.202150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:42293 (local address 127.0.0.1:43602)
0923 14:44:42.203309 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.203323 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.203415 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.203979 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.203982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.204000 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:42.204118 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.204126 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.205212 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.205216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.206687 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.206697 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.207892 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.207896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.208028 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.208051 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.208117 (+ 66us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.209054 (+ 937us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1099,"mutex_wait_us":833,"thread_start_us":102,"threads_started":1}
I20260923 14:44:42.210292 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.203328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:41969 (local address 127.0.0.1:35142)
0923 14:44:42.203899 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.203914 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.203988 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.205649 (+ 1661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.205652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.205671 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:42.205781 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.205787 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.207084 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.207090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.208210 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.208219 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.209941 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.209947 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.210044 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.210071 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.210156 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.210206 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":80,"threads_started":1}
I20260923 14:44:42.210444 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.203504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35142 (local address 127.17.4.130:41969)
0923 14:44:42.205221 (+ 1717us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.205233 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.205267 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:44:42.205337 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.205341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.205507 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.205656 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:42.205909 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.206969 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.208336 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.209654 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.209746 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.209864 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.210204 (+ 340us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.210302 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1581,"thread_start_us":120,"threads_started":1}
I20260923 14:44:42.212255 3501 tablet_service.cc:1467] Processing CreateTablet for tablet a6f2e796ca134e87a11c13474c2de64a (DEFAULT_TABLE table=test-table [id=6328867ad25849fdbce555b8563a9259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:42.212877 3367 tablet_service.cc:1467] Processing CreateTablet for tablet a6f2e796ca134e87a11c13474c2de64a (DEFAULT_TABLE table=test-table [id=6328867ad25849fdbce555b8563a9259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:42.213416 3501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f2e796ca134e87a11c13474c2de64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:42.213301 3232 tablet_service.cc:1467] Processing CreateTablet for tablet a6f2e796ca134e87a11c13474c2de64a (DEFAULT_TABLE table=test-table [id=6328867ad25849fdbce555b8563a9259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:42.213838 3367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f2e796ca134e87a11c13474c2de64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:42.214201 3232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f2e796ca134e87a11c13474c2de64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:42.219993 3584 tablet_bootstrap.cc:492] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: Bootstrap starting.
I20260923 14:44:42.221406 3585 tablet_bootstrap.cc:492] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Bootstrap starting.
I20260923 14:44:42.222740 3584 tablet_bootstrap.cc:654] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:42.223455 3585 tablet_bootstrap.cc:654] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:42.224078 3586 tablet_bootstrap.cc:492] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Bootstrap starting.
I20260923 14:44:42.224567 3584 log.cc:824] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:42.224687 3585 log.cc:824] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:42.226070 3586 tablet_bootstrap.cc:654] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:42.226522 3585 tablet_bootstrap.cc:492] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: No bootstrap required, opened a new log
I20260923 14:44:42.226723 3585 ts_tablet_manager.cc:1397] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:44:42.227259 3586 log.cc:824] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:42.227453 3584 tablet_bootstrap.cc:492] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: No bootstrap required, opened a new log
I20260923 14:44:42.227644 3584 ts_tablet_manager.cc:1397] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260923 14:44:42.228987 3586 tablet_bootstrap.cc:492] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: No bootstrap required, opened a new log
I20260923 14:44:42.229182 3586 ts_tablet_manager.cc:1397] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260923 14:44:42.230684 3585 raft_consensus.cc:348] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.230967 3585 raft_consensus.cc:374] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:42.231016 3585 raft_consensus.cc:729] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 790f4efa33a24ea7b160ea57e1223e7c, State: Initialized, Role: FOLLOWER
I20260923 14:44:42.231496 3585 consensus_queue.cc:260] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.231549 3584 raft_consensus.cc:348] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.231806 3584 raft_consensus.cc:374] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:42.231868 3584 raft_consensus.cc:729] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a14dba8fb0c41e59672777fc91975dd, State: Initialized, Role: FOLLOWER
I20260923 14:44:42.232277 3433 heartbeater.cc:503] Master 127.17.4.190:34917 was elected leader, sending a full tablet report...
I20260923 14:44:42.232314 3584 consensus_queue.cc:260] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.232689 3585 ts_tablet_manager.cc:1428] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260923 14:44:42.232947 3586 raft_consensus.cc:348] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.233189 3586 raft_consensus.cc:374] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:42.233189 3584 ts_tablet_manager.cc:1428] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260923 14:44:42.233196 3299 heartbeater.cc:503] Master 127.17.4.190:34917 was elected leader, sending a full tablet report...
I20260923 14:44:42.233251 3586 raft_consensus.cc:729] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d2e125d79874a91b19e7f747967cb50, State: Initialized, Role: FOLLOWER
W20260923 14:44:42.233677 3300 tablet.cc:2369] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:42.233683 3586 consensus_queue.cc:260] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.234525 3586 ts_tablet_manager.cc:1428] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260923 14:44:42.234680 3567 heartbeater.cc:503] Master 127.17.4.190:34917 was elected leader, sending a full tablet report...
I20260923 14:44:42.324013 3590 raft_consensus.cc:482] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:42.324214 3590 raft_consensus.cc:504] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.325277 3590 leader_election.cc:288] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d2e125d79874a91b19e7f747967cb50 (127.17.4.131:36133), 3a14dba8fb0c41e59672777fc91975dd (127.17.4.129:42293)
I20260923 14:44:42.329941 3580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.325591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:39835 (local address 127.17.4.131:36133)
0923 14:44:42.325737 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.325742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.325761 (+ 19us) server_negotiation.cc:407] Connection header received
0923 14:44:42.325816 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.325819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.325871 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.325953 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:42.326285 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.327048 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.328545 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.329192 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.329310 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.329374 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.329734 (+ 360us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.329808 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 14:44:42.329941 3581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.325614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:34037 (local address 127.17.4.129:42293)
0923 14:44:42.325731 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.325735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.326238 (+ 503us) server_negotiation.cc:407] Connection header received
0923 14:44:42.326327 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.326330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.326378 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.326455 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:42.326683 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.327314 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.328690 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.329277 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.329380 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.329432 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.329736 (+ 304us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.329809 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 14:44:42.330035 3435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.325493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:36133 (local address 127.17.4.130:39835)
0923 14:44:42.325613 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.325630 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.325718 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.326003 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.326007 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.326029 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:42.326158 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.326169 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.327165 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.327167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.328432 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.328442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.329338 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.329344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.329536 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.329614 (+ 78us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.329690 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.329858 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":106}
I20260923 14:44:42.330428 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.325507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:42293 (local address 127.17.4.130:34037)
0923 14:44:42.326122 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.326136 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.326235 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.326472 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.326474 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.326487 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:42.326575 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.326579 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.327410 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.327413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.328588 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.328595 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.329375 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.329378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.329539 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.329613 (+ 74us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.329694 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.329867 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":419,"thread_start_us":126,"threads_started":1}
I20260923 14:44:42.330799 3521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f2e796ca134e87a11c13474c2de64a" candidate_uuid: "790f4efa33a24ea7b160ea57e1223e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2e125d79874a91b19e7f747967cb50" is_pre_election: true
I20260923 14:44:42.331154 3521 raft_consensus.cc:2454] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 790f4efa33a24ea7b160ea57e1223e7c in term 0.
I20260923 14:44:42.331182 3252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f2e796ca134e87a11c13474c2de64a" candidate_uuid: "790f4efa33a24ea7b160ea57e1223e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a14dba8fb0c41e59672777fc91975dd" is_pre_election: true
I20260923 14:44:42.331454 3252 raft_consensus.cc:2454] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 790f4efa33a24ea7b160ea57e1223e7c in term 0.
I20260923 14:44:42.331658 3322 leader_election.cc:302] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d2e125d79874a91b19e7f747967cb50, 790f4efa33a24ea7b160ea57e1223e7c; no voters:
I20260923 14:44:42.331955 3590 raft_consensus.cc:2781] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:42.332053 3590 raft_consensus.cc:482] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:42.332118 3590 raft_consensus.cc:3037] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:42.333292 3590 raft_consensus.cc:504] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.333647 3590 leader_election.cc:288] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [CANDIDATE]: Term 1 election: Requested vote from peers 4d2e125d79874a91b19e7f747967cb50 (127.17.4.131:36133), 3a14dba8fb0c41e59672777fc91975dd (127.17.4.129:42293)
I20260923 14:44:42.334045 3252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f2e796ca134e87a11c13474c2de64a" candidate_uuid: "790f4efa33a24ea7b160ea57e1223e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a14dba8fb0c41e59672777fc91975dd"
I20260923 14:44:42.334045 3521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f2e796ca134e87a11c13474c2de64a" candidate_uuid: "790f4efa33a24ea7b160ea57e1223e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d2e125d79874a91b19e7f747967cb50"
I20260923 14:44:42.334188 3521 raft_consensus.cc:3037] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:42.334177 3252 raft_consensus.cc:3037] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:42.335460 3521 raft_consensus.cc:2454] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 790f4efa33a24ea7b160ea57e1223e7c in term 1.
I20260923 14:44:42.335460 3252 raft_consensus.cc:2454] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 790f4efa33a24ea7b160ea57e1223e7c in term 1.
I20260923 14:44:42.335798 3323 leader_election.cc:302] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3a14dba8fb0c41e59672777fc91975dd, 4d2e125d79874a91b19e7f747967cb50, 790f4efa33a24ea7b160ea57e1223e7c; no voters:
I20260923 14:44:42.336005 3590 raft_consensus.cc:2781] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:42.336232 3590 raft_consensus.cc:686] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 1 LEADER]: Becoming Leader. State: Replica: 790f4efa33a24ea7b160ea57e1223e7c, State: Running, Role: LEADER
I20260923 14:44:42.336591 3590 consensus_queue.cc:237] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } }
I20260923 14:44:42.339982 3106 catalog_manager.cc:5495] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 790f4efa33a24ea7b160ea57e1223e7c (127.17.4.130). New cstate: current_term: 1 leader_uuid: "790f4efa33a24ea7b160ea57e1223e7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "790f4efa33a24ea7b160ea57e1223e7c" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260923 14:44:42.361006 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.357306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35146 (local address 127.17.4.130:41969)
0923 14:44:42.357475 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.357480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.357495 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:44:42.357654 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.357657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.357711 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.357825 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:42.358073 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.358574 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.359454 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.359678 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.359812 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.360128 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:42.360548 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:42.360720 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.360806 (+ 86us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.360843 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 14:44:42.367095 3521 raft_consensus.cc:1261] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 1 FOLLOWER]: Refusing update from remote peer 790f4efa33a24ea7b160ea57e1223e7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:42.367091 3252 raft_consensus.cc:1261] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd [term 1 FOLLOWER]: Refusing update from remote peer 790f4efa33a24ea7b160ea57e1223e7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:42.367852 3590 consensus_queue.cc:1035] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d2e125d79874a91b19e7f747967cb50" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:42.368076 3594 consensus_queue.cc:1035] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a14dba8fb0c41e59672777fc91975dd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 42293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:42.383688 3106 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:42.383895 3106 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:42.386222 3106 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56b0c60bbcdb40ad8192d4bfff3d5ff5: Sending DeleteTablet for 3 replicas of tablet a6f2e796ca134e87a11c13474c2de64a
I20260923 14:44:42.387008 3367 tablet_service.cc:1514] Processing DeleteTablet for tablet a6f2e796ca134e87a11c13474c2de64a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:42 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:35142
I20260923 14:44:42.386974 3501 tablet_service.cc:1514] Processing DeleteTablet for tablet a6f2e796ca134e87a11c13474c2de64a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:42 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:53490
I20260923 14:44:42.387039 3232 tablet_service.cc:1514] Processing DeleteTablet for tablet a6f2e796ca134e87a11c13474c2de64a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:42 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:43602
I20260923 14:44:42.387513 3609 tablet_replica.cc:330] T a6f2e796ca134e87a11c13474c2de64a P 3a14dba8fb0c41e59672777fc91975dd: stopping tablet replica
I20260923 14:44:42.387692 3608 tablet_replica.cc:330] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: stopping tablet replica
I20260923 14:44:42.387991 3608 raft_consensus.cc:2229] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:42.388222 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3169
I20260923 14:44:42.390343 3608 raft_consensus.cc:2258] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:42.390733 3607 tablet_replica.cc:330] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: stopping tablet replica
I20260923 14:44:42.391000 3607 raft_consensus.cc:2229] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:44:42.391878 3607 raft_consensus.cc:2258] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:42.392952 3608 ts_tablet_manager.cc:1905] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:42.393142 3607 ts_tablet_manager.cc:1905] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:42.395751 3608 ts_tablet_manager.cc:1918] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:42.396032 3608 log.cc:1196] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/a6f2e796ca134e87a11c13474c2de64a
I20260923 14:44:42.396432 3608 ts_tablet_manager.cc:1939] T a6f2e796ca134e87a11c13474c2de64a P 4d2e125d79874a91b19e7f747967cb50: Deleting consensus metadata
I20260923 14:44:42.396575 3607 ts_tablet_manager.cc:1918] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:42.396697 3607 log.cc:1196] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/a6f2e796ca134e87a11c13474c2de64a
I20260923 14:44:42.397027 3607 ts_tablet_manager.cc:1939] T a6f2e796ca134e87a11c13474c2de64a P 790f4efa33a24ea7b160ea57e1223e7c: Deleting consensus metadata
W20260923 14:44:42.397322 3093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:42293 (error 108)
I20260923 14:44:42.397500 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3304
I20260923 14:44:42.398936 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.398651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:42293 (local address 127.0.0.1:43610)
0923 14:44:42.398784 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.398853 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260923 14:44:42.399119 3093 catalog_manager.cc:4584] TS 3a14dba8fb0c41e59672777fc91975dd (127.17.4.129:42293): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6f2e796ca134e87a11c13474c2de64a: Network error: Client connection negotiation failed: client connection to 127.17.4.129:42293: connect: Connection refused (error 111)
I20260923 14:44:42.400484 3092 catalog_manager.cc:4841] TS 4d2e125d79874a91b19e7f747967cb50 (127.17.4.131:36133): tablet a6f2e796ca134e87a11c13474c2de64a (table test-table [id=6328867ad25849fdbce555b8563a9259]) successfully deleted
I20260923 14:44:42.403541 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3438
I20260923 14:44:42.404462 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.403851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:41969 (local address 127.0.0.1:35152)
0923 14:44:42.404273 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.404327 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.130:41969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322}
I20260923 14:44:42.409881 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3074
2026-09-23T14:44:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2274 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-23T14:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:42Z Disabled control of system clock
I20260923 14:44:42.440080 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43967
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:33073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:43967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 14:44:42.549965 3614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:42.550228 3614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:42.550263 3614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:42.554240 3614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:42.554293 3614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:42.554308 3614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:42.554324 3614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:42.554383 3614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:42.559115 3614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:43967
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:42.560204 3614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:42.561549 3614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:42.570320 3619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:42.570356 3620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:42.570320 3622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:42.570544 3614 server_base.cc:1034] running on GCE node
I20260923 14:44:42.571224 3614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:42.572328 3614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:42.573503 3614 hybrid_clock.cc:648] HybridClock initialized: now 1790174682573489 us; error 25 us; skew 500 ppm
I20260923 14:44:42.575423 3614 webserver.cc:460] Webserver started at http://127.17.4.190:40975/ using document root <none> and password file <none>
I20260923 14:44:42.576054 3614 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:42.576123 3614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:42.576377 3614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:42.578379 3614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "293df0cb584019ce1e334e6184c7522e"
server_key_iv: "ceead42ef2f118d62e136feae2e7b478"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.578938 3614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "293df0cb584019ce1e334e6184c7522e"
server_key_iv: "ceead42ef2f118d62e136feae2e7b478"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.582653 3614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:44:42.585134 3628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.586372 3614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:42.586510 3614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "293df0cb584019ce1e334e6184c7522e"
server_key_iv: "ceead42ef2f118d62e136feae2e7b478"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.586620 3614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:42.611748 3614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:42.612524 3614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:42.612727 3614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:42.619617 3614 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:43967
I20260923 14:44:42.619647 3680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:43967 every 8 connection(s)
I20260923 14:44:42.620586 3614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:42.623606 3681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:42.625972 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3614
I20260923 14:44:42.626096 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:42.626406 17426 external_mini_cluster.cc:1428] Setting key 0317dae1726a33e43419644baeed7804
I20260923 14:44:42.629953 3681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: Bootstrap starting.
I20260923 14:44:42.632329 3681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:42.633272 3681 log.cc:824] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:42.635656 3681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: No bootstrap required, opened a new log
I20260923 14:44:42.636507 3684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.627929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38628 (local address 127.17.4.190:43967)
0923 14:44:42.628644 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.628663 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.628701 (+ 38us) server_negotiation.cc:407] Connection header received
0923 14:44:42.629369 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.629388 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.629814 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.630185 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:42.630627 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.631618 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.632618 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.633353 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.633542 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.634390 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:42.634396 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:42.634412 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:42.634907 (+ 495us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:42.634978 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:42.635005 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:42.635108 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.635234 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.635512 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":160,"threads_started":1}
I20260923 14:44:42.639873 3681 raft_consensus.cc:348] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43967 } }
I20260923 14:44:42.640097 3681 raft_consensus.cc:374] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:42.640147 3681 raft_consensus.cc:729] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d325d803cd8d4ff0b2e6e88ee8c5de7e, State: Initialized, Role: FOLLOWER
I20260923 14:44:42.640583 3681 consensus_queue.cc:260] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43967 } }
I20260923 14:44:42.640709 3681 raft_consensus.cc:388] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:42.640764 3681 raft_consensus.cc:482] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:42.640834 3681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:42.641746 3681 raft_consensus.cc:504] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43967 } }
I20260923 14:44:42.642042 3681 leader_election.cc:302] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d325d803cd8d4ff0b2e6e88ee8c5de7e; no voters:
I20260923 14:44:42.642379 3681 leader_election.cc:288] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:42.642483 3686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:42.642706 3686 raft_consensus.cc:686] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [term 1 LEADER]: Becoming Leader. State: Replica: d325d803cd8d4ff0b2e6e88ee8c5de7e, State: Running, Role: LEADER
I20260923 14:44:42.643046 3686 consensus_queue.cc:237] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43967 } }
I20260923 14:44:42.643633 3681 sys_catalog.cc:564] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:42.644788 3688 sys_catalog.cc:455] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d325d803cd8d4ff0b2e6e88ee8c5de7e. Latest consensus state: current_term: 1 leader_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43967 } } }
I20260923 14:44:42.644788 3687 sys_catalog.cc:455] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d325d803cd8d4ff0b2e6e88ee8c5de7e" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43967 } } }
I20260923 14:44:42.644954 3687 sys_catalog.cc:458] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:42.644954 3688 sys_catalog.cc:458] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e [sys.catalog]: This master's current role is: LEADER
W20260923 14:44:42.648876 3701 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:44:42.648965 3701 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:44:42.649041 3695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:42.649721 3695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:42.655153 3695 catalog_manager.cc:1347] Generated new cluster ID: 4f2d299406c545ffa0fe3457b14bb75d
I20260923 14:44:42.655215 3695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:42.684406 3695 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:42.685660 3695 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:42.691517 3695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: Generated new TSK 0
I20260923 14:44:42.692306 3695 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:42.701815 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:43967
--builtin_ntp_servers=127.17.4.148:33073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 14:44:42.815629 3705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:42.815992 3705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:42.816056 3705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:42.820204 3705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:42.820257 3705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:42.820312 3705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:42.825112 3705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:43967
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:42.826165 3705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:42.827591 3705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:42.837623 3710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:42.837615 3711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:42.837724 3705 server_base.cc:1034] running on GCE node
W20260923 14:44:42.837615 3713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:42.838364 3705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:42.838995 3705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:42.840186 3705 hybrid_clock.cc:648] HybridClock initialized: now 1790174682840155 us; error 53 us; skew 500 ppm
I20260923 14:44:42.842163 3705 webserver.cc:460] Webserver started at http://127.17.4.129:37003/ using document root <none> and password file <none>
I20260923 14:44:42.842763 3705 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:42.842859 3705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:42.843102 3705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:42.845460 3705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "705a4d341a2747acaf316c9f21438605"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "c62771ff13dd219fa88cb2c7af45cee5"
server_key_iv: "5dcaceca45f3f03551d59b4f4751cde0"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.846064 3705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "705a4d341a2747acaf316c9f21438605"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "c62771ff13dd219fa88cb2c7af45cee5"
server_key_iv: "5dcaceca45f3f03551d59b4f4751cde0"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.849852 3705 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 14:44:42.852391 3720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.853685 3705 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:42.853838 3705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "705a4d341a2747acaf316c9f21438605"
format_stamp: "Formatted at 2026-09-23 14:44:42 on dist-test-slave-54kg"
server_key: "c62771ff13dd219fa88cb2c7af45cee5"
server_key_iv: "5dcaceca45f3f03551d59b4f4751cde0"
server_key_version: "encryptionkey@0"
I20260923 14:44:42.853963 3705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:42.868216 3705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:42.868954 3705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:42.869169 3705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:42.869761 3705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:42.870710 3705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:42.870779 3705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.870854 3705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:42.870898 3705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:42.879652 3705 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:38941
I20260923 14:44:42.879685 3834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:38941 every 8 connection(s)
I20260923 14:44:42.880613 3705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:42.888398 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3705
I20260923 14:44:42.888531 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:44:42.888882 17426 external_mini_cluster.cc:1428] Setting key ec0d5bd539f70bb582a698ed856fe4cf
I20260923 14:44:42.889914 3684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.882484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:52509 (local address 127.17.4.190:43967)
0923 14:44:42.882630 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:42.882634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:42.883691 (+ 1057us) server_negotiation.cc:407] Connection header received
0923 14:44:42.885058 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:42.885061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:42.885108 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:42.885188 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:42.886067 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.886587 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.887726 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.888031 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.888147 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.889449 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:42.889454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:42.889456 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:42.889471 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:42.889493 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:42.889504 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:42.889580 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:42.889754 (+ 174us) server_negotiation.cc:299] Negotiation successful
0923 14:44:42.889805 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:44:42.890913 3837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:42.882876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:43967 (local address 127.17.4.129:52509)
0923 14:44:42.883519 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:42.883557 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:42.884857 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:42.885349 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:42.885355 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:42.885439 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:42.885940 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.885953 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.886700 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.886703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.887606 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:42.887615 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:42.888227 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:42.888232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:42.888440 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:42.889126 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:42.889128 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:42.889181 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:42.889244 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:42.889598 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:42.889610 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:42.889616 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 14:44:42.889747 (+ 131us) client_negotiation.cc:240] Negotiation successful
0923 14:44:42.890018 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":106,"threads_started":1}
I20260923 14:44:42.891278 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:43967
--builtin_ntp_servers=127.17.4.148:33073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 14:44:42.892069 3835 heartbeater.cc:347] Connected to a master server at 127.17.4.190:43967
I20260923 14:44:42.892321 3835 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:42.892923 3835 heartbeater.cc:511] Master 127.17.4.190:43967 requested a full tablet report, sending...
I20260923 14:44:42.894469 3645 ts_manager.cc:194] Registered new tserver with Master: 705a4d341a2747acaf316c9f21438605 (127.17.4.129:38941)
I20260923 14:44:42.895596 3645 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.129:52509
W20260923 14:44:43.003077 3838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:43.003346 3838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:43.003423 3838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:43.007452 3838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:43.007519 3838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:43.007601 3838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:43.012303 3838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:43967
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:43.013325 3838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:43.014642 3838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:43.024111 3844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:43.024120 3843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:43.024273 3838 server_base.cc:1034] running on GCE node
W20260923 14:44:43.024459 3846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:43.024837 3838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:43.025486 3838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:43.026669 3838 hybrid_clock.cc:648] HybridClock initialized: now 1790174683026648 us; error 31 us; skew 500 ppm
I20260923 14:44:43.028473 3838 webserver.cc:460] Webserver started at http://127.17.4.130:36795/ using document root <none> and password file <none>
I20260923 14:44:43.029019 3838 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:43.029117 3838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:43.029343 3838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:43.031338 3838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "b346c60329204db28c32c61ed8f198e7"
format_stamp: "Formatted at 2026-09-23 14:44:43 on dist-test-slave-54kg"
server_key: "ec4f36ec95b39ea755f0d5c5b346bb73"
server_key_iv: "6e6ffcc47ae75a30e683feea74ca42c5"
server_key_version: "encryptionkey@0"
I20260923 14:44:43.031944 3838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "b346c60329204db28c32c61ed8f198e7"
format_stamp: "Formatted at 2026-09-23 14:44:43 on dist-test-slave-54kg"
server_key: "ec4f36ec95b39ea755f0d5c5b346bb73"
server_key_iv: "6e6ffcc47ae75a30e683feea74ca42c5"
server_key_version: "encryptionkey@0"
I20260923 14:44:43.035606 3838 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:44:43.038024 3852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:43.039173 3838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:43.039306 3838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "b346c60329204db28c32c61ed8f198e7"
format_stamp: "Formatted at 2026-09-23 14:44:43 on dist-test-slave-54kg"
server_key: "ec4f36ec95b39ea755f0d5c5b346bb73"
server_key_iv: "6e6ffcc47ae75a30e683feea74ca42c5"
server_key_version: "encryptionkey@0"
I20260923 14:44:43.039412 3838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:43.072808 3838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:43.073529 3838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:43.073733 3838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:43.074326 3838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:43.075289 3838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:43.075358 3838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:43.075426 3838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:43.075469 3838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:43.084441 3838 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:39175
I20260923 14:44:43.084472 3966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:39175 every 8 connection(s)
I20260923 14:44:43.085342 3838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:44:43.088033 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3838
I20260923 14:44:43.088174 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:44:43.088481 17426 external_mini_cluster.cc:1428] Setting key c6651cc6bf99b48d7fdaffef996c9159
I20260923 14:44:43.090704 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:43967
--builtin_ntp_servers=127.17.4.148:33073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 14:44:43.095743 3684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.087109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:57445 (local address 127.17.4.190:43967)
0923 14:44:43.087256 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.087262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.088432 (+ 1170us) server_negotiation.cc:407] Connection header received
0923 14:44:43.090183 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.090187 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.090255 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.090342 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:43.091334 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.092228 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.093801 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.094006 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.094128 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.095227 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:43.095233 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:43.095240 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:43.095252 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:43.095269 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:43.095277 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:43.095356 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.095514 (+ 158us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.095573 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:44:43.096585 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.087530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:43967 (local address 127.17.4.130:57445)
0923 14:44:43.088294 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.088335 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.089969 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.090505 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.090511 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.090597 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:43.091200 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.091215 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.092380 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.092386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.093693 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.093703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.094158 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.094162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.094328 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.094975 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:43.094977 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:43.095015 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:43.095074 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:43.095358 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:43.095370 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:43.095377 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.095513 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.095849 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":113,"threads_started":1}
I20260923 14:44:43.097889 3967 heartbeater.cc:347] Connected to a master server at 127.17.4.190:43967
I20260923 14:44:43.098132 3967 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:43.098623 3967 heartbeater.cc:511] Master 127.17.4.190:43967 requested a full tablet report, sending...
I20260923 14:44:43.099741 3645 ts_manager.cc:194] Registered new tserver with Master: b346c60329204db28c32c61ed8f198e7 (127.17.4.130:39175)
I20260923 14:44:43.100663 3645 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.130:57445
W20260923 14:44:43.203135 3970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:43.203393 3970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:43.203433 3970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:43.207482 3970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:43.207533 3970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:43.207587 3970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:43.212204 3970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:33073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:43967
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:43.213225 3970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:43.214766 3970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:43.224328 3975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:43.224330 3976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:43.224403 3978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:43.224725 3970 server_base.cc:1034] running on GCE node
I20260923 14:44:43.225071 3970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:43.225700 3970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:43.226859 3970 hybrid_clock.cc:648] HybridClock initialized: now 1790174683226847 us; error 27 us; skew 500 ppm
I20260923 14:44:43.228796 3970 webserver.cc:460] Webserver started at http://127.17.4.131:38955/ using document root <none> and password file <none>
I20260923 14:44:43.229331 3970 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:43.229388 3970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:43.229552 3970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:43.231546 3970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "10c3dc0b0c264fc19ad348c0191071ec"
format_stamp: "Formatted at 2026-09-23 14:44:43 on dist-test-slave-54kg"
server_key: "3180cc96ad4a715d9f3b86d121160702"
server_key_iv: "cec068798e5c862357f5603f48904f94"
server_key_version: "encryptionkey@0"
I20260923 14:44:43.232120 3970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "10c3dc0b0c264fc19ad348c0191071ec"
format_stamp: "Formatted at 2026-09-23 14:44:43 on dist-test-slave-54kg"
server_key: "3180cc96ad4a715d9f3b86d121160702"
server_key_iv: "cec068798e5c862357f5603f48904f94"
server_key_version: "encryptionkey@0"
I20260923 14:44:43.235857 3970 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 14:44:43.238185 3984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:43.239387 3970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:43.239516 3970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "10c3dc0b0c264fc19ad348c0191071ec"
format_stamp: "Formatted at 2026-09-23 14:44:43 on dist-test-slave-54kg"
server_key: "3180cc96ad4a715d9f3b86d121160702"
server_key_iv: "cec068798e5c862357f5603f48904f94"
server_key_version: "encryptionkey@0"
I20260923 14:44:43.239622 3970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:43.262708 3970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:43.263398 3970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:43.263590 3970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:43.264194 3970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:43.265120 3970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:43.265196 3970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:43.265264 3970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:43.265312 3970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:43.273813 3970 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:37341
I20260923 14:44:43.273849 4097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:37341 every 8 connection(s)
I20260923 14:44:43.274709 3970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:43.277885 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 3970
I20260923 14:44:43.278013 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:44:43.278330 17426 external_mini_cluster.cc:1428] Setting key 1baae6bc87605b77b511acfb0b3c2d28
I20260923 14:44:43.284209 3684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.276601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:60679 (local address 127.17.4.190:43967)
0923 14:44:43.276770 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.276776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.277831 (+ 1055us) server_negotiation.cc:407] Connection header received
0923 14:44:43.279681 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.279684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.279752 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.279850 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:43.280888 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.281411 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.282497 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.282708 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.282781 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.283807 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:43.283810 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:43.283812 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:43.283823 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:43.283840 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:43.283848 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:43.283904 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.284040 (+ 136us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.284087 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 14:44:43.285019 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.276996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:43967 (local address 127.17.4.131:60679)
0923 14:44:43.277660 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.277716 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.279441 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.280026 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.280033 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.280130 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:43.280760 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.280773 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.281522 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.281524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.282394 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.282403 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.282833 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.282836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.282977 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.283560 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:43.283563 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:43.283601 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:43.283660 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:43.283920 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:43.283927 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:43.283931 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.284026 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.284255 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":107,"threads_started":1}
I20260923 14:44:43.286111 4098 heartbeater.cc:347] Connected to a master server at 127.17.4.190:43967
I20260923 14:44:43.286305 4098 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:43.286746 4098 heartbeater.cc:511] Master 127.17.4.190:43967 requested a full tablet report, sending...
I20260923 14:44:43.287734 3645 ts_manager.cc:194] Registered new tserver with Master: 10c3dc0b0c264fc19ad348c0191071ec (127.17.4.131:37341)
I20260923 14:44:43.288376 3645 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.131:60679
I20260923 14:44:43.292125 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:43.297461 3684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.293990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38636 (local address 127.17.4.190:43967)
0923 14:44:43.294109 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.294113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.294229 (+ 116us) server_negotiation.cc:407] Connection header received
0923 14:44:43.294318 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.294320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.294352 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.294414 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:43.294668 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.295180 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.296071 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.296285 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.296362 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.297082 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:43.297085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:43.297087 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:43.297097 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:43.297116 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:43.297124 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:43.297214 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.297316 (+ 102us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.297346 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:43.300304 3645 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:43.303233 3645 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:43.317142 4110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.311478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39175 (local address 127.0.0.1:47762)
0923 14:44:43.312569 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.312583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.312731 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.313255 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.313258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.313275 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:43.313370 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.313379 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.314562 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.314565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.315576 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.315591 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.316623 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.316627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.316731 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.316766 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.316870 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.316985 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"mutex_wait_us":28,"thread_start_us":102,"threads_started":1}
I20260923 14:44:43.317150 4113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.312187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.17.4.130:39175)
0923 14:44:43.312523 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.312534 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.312665 (+ 131us) server_negotiation.cc:407] Connection header received
0923 14:44:43.312885 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.312891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.313091 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.313534 (+ 443us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:43.313667 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.314447 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.315726 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.316491 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.316615 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.316806 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.316897 (+ 91us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.316986 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":133,"threads_started":1}
I20260923 14:44:43.317687 4112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.312132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:37341 (local address 127.0.0.1:51144)
0923 14:44:43.312930 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.312942 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.313112 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.313562 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.313565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.313581 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:43.313673 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.313679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.314937 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.314941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.316065 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.316073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.317210 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.317213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.317312 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.317341 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.317401 (+ 60us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.317448 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"mutex_wait_us":28,"thread_start_us":98,"threads_started":1}
I20260923 14:44:43.317803 4114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.312323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.17.4.131:37341)
0923 14:44:43.312705 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.312718 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.313043 (+ 325us) server_negotiation.cc:407] Connection header received
0923 14:44:43.313258 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.313264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.313427 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.313570 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:43.313797 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.314826 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.316194 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.316917 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.317005 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.317161 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.317534 (+ 373us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.317644 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":141,"threads_started":1}
I20260923 14:44:43.317842 4111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.311531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.17.4.129:38941)
0923 14:44:43.312015 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.312029 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.312057 (+ 28us) server_negotiation.cc:407] Connection header received
0923 14:44:43.312249 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.312256 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.312484 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.312636 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:43.313119 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.314276 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.316023 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.316807 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.316914 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.317095 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.317574 (+ 479us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.317684 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":130,"threads_started":1}
I20260923 14:44:43.317924 4109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.311392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:38941 (local address 127.0.0.1:36100)
0923 14:44:43.311862 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.311906 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.312028 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.312801 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.312808 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.312832 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:43.312958 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.312988 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.314393 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.314396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.315877 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.315888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.317161 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.317165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.317258 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.317299 (+ 41us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.317371 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.317443 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":56,"thread_start_us":87,"threads_started":1}
I20260923 14:44:43.320495 3900 tablet_service.cc:1467] Processing CreateTablet for tablet 7407fc0e2a16478fa0a8a8a64f6f603f (DEFAULT_TABLE table=test-table [id=7329b04b4fba4ad98264606a37fc2af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:43.320518 3768 tablet_service.cc:1467] Processing CreateTablet for tablet 7407fc0e2a16478fa0a8a8a64f6f603f (DEFAULT_TABLE table=test-table [id=7329b04b4fba4ad98264606a37fc2af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:43.320516 4032 tablet_service.cc:1467] Processing CreateTablet for tablet 7407fc0e2a16478fa0a8a8a64f6f603f (DEFAULT_TABLE table=test-table [id=7329b04b4fba4ad98264606a37fc2af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:43.321457 3900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7407fc0e2a16478fa0a8a8a64f6f603f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:43.321478 3768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7407fc0e2a16478fa0a8a8a64f6f603f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:43.321478 4032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7407fc0e2a16478fa0a8a8a64f6f603f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:43.328613 4115 tablet_bootstrap.cc:492] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Bootstrap starting.
I20260923 14:44:43.328908 4117 tablet_bootstrap.cc:492] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: Bootstrap starting.
I20260923 14:44:43.331086 4115 tablet_bootstrap.cc:654] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:43.331086 4117 tablet_bootstrap.cc:654] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:43.332011 4116 tablet_bootstrap.cc:492] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Bootstrap starting.
I20260923 14:44:43.332043 4117 log.cc:824] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:43.332043 4115 log.cc:824] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:43.334213 4116 tablet_bootstrap.cc:654] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:43.334631 4117 tablet_bootstrap.cc:492] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: No bootstrap required, opened a new log
I20260923 14:44:43.334762 4115 tablet_bootstrap.cc:492] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: No bootstrap required, opened a new log
I20260923 14:44:43.334839 4117 ts_tablet_manager.cc:1397] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:44:43.334920 4115 ts_tablet_manager.cc:1397] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260923 14:44:43.335060 4116 log.cc:824] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:43.336836 4116 tablet_bootstrap.cc:492] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: No bootstrap required, opened a new log
I20260923 14:44:43.337033 4116 ts_tablet_manager.cc:1397] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:44:43.339115 4115 raft_consensus.cc:348] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.339124 4117 raft_consensus.cc:348] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.339398 4115 raft_consensus.cc:374] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:43.339398 4117 raft_consensus.cc:374] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:43.339457 4115 raft_consensus.cc:729] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b346c60329204db28c32c61ed8f198e7, State: Initialized, Role: FOLLOWER
I20260923 14:44:43.339465 4117 raft_consensus.cc:729] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 705a4d341a2747acaf316c9f21438605, State: Initialized, Role: FOLLOWER
I20260923 14:44:43.339960 4115 consensus_queue.cc:260] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.339960 4117 consensus_queue.cc:260] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.340440 4116 raft_consensus.cc:348] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.340698 4116 raft_consensus.cc:374] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:43.340750 4116 raft_consensus.cc:729] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c3dc0b0c264fc19ad348c0191071ec, State: Initialized, Role: FOLLOWER
I20260923 14:44:43.341010 4115 ts_tablet_manager.cc:1428] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 14:44:43.341010 4117 ts_tablet_manager.cc:1428] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 14:44:43.341372 3835 heartbeater.cc:503] Master 127.17.4.190:43967 was elected leader, sending a full tablet report...
I20260923 14:44:43.341369 3967 heartbeater.cc:503] Master 127.17.4.190:43967 was elected leader, sending a full tablet report...
I20260923 14:44:43.341212 4116 consensus_queue.cc:260] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.343009 4098 heartbeater.cc:503] Master 127.17.4.190:43967 was elected leader, sending a full tablet report...
I20260923 14:44:43.343935 4116 ts_tablet_manager.cc:1428] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260923 14:44:43.381937 3836 tablet.cc:2369] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:44:43.525765 4099 tablet.cc:2369] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 14:44:43.586449 3968 tablet.cc:2369] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:43.760325 4122 raft_consensus.cc:482] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:43.760592 4122 raft_consensus.cc:504] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.761837 4122 leader_election.cc:288] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b346c60329204db28c32c61ed8f198e7 (127.17.4.130:39175), 10c3dc0b0c264fc19ad348c0191071ec (127.17.4.131:37341)
I20260923 14:44:43.767136 4113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.762311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:33625 (local address 127.17.4.130:39175)
0923 14:44:43.762440 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.762444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.762569 (+ 125us) server_negotiation.cc:407] Connection header received
0923 14:44:43.762685 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.762688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.762743 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.762839 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:43.763304 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.764128 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.765905 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.766491 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.766615 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.766663 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.766942 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.767008 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:43.767136 4114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.762236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:49103 (local address 127.17.4.131:37341)
0923 14:44:43.762377 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.762383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.762569 (+ 186us) server_negotiation.cc:407] Connection header received
0923 14:44:43.762685 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.762688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.762743 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.762839 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:43.763298 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.764128 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.765905 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.766491 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.766616 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.766663 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.766942 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.767008 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:44:43.767185 4125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.762078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:39175 (local address 127.17.4.129:33625)
0923 14:44:43.762452 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.762464 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.762588 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.762865 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.762868 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.762892 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:43.763171 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.763177 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.764256 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.764260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.765753 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.765764 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.766618 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.766622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.766772 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.766839 (+ 67us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.766912 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.767003 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":343,"spinlock_wait_cycles":27392,"thread_start_us":45,"threads_started":1}
I20260923 14:44:43.767185 4124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.762079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:37341 (local address 127.17.4.129:49103)
0923 14:44:43.762434 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.762449 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:43.762588 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:43.762865 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:43.762868 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:43.762892 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:43.763162 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.763171 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.764256 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.764260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.765753 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:43.765764 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.766618 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.766622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:43.766774 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.766835 (+ 61us) client_negotiation.cc:769] Sending connection context
0923 14:44:43.766912 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 14:44:43.767003 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":293,"spinlock_wait_cycles":11648,"thread_start_us":90,"threads_started":1}
I20260923 14:44:43.767964 3920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7407fc0e2a16478fa0a8a8a64f6f603f" candidate_uuid: "705a4d341a2747acaf316c9f21438605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b346c60329204db28c32c61ed8f198e7" is_pre_election: true
I20260923 14:44:43.767984 4052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7407fc0e2a16478fa0a8a8a64f6f603f" candidate_uuid: "705a4d341a2747acaf316c9f21438605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c3dc0b0c264fc19ad348c0191071ec" is_pre_election: true
I20260923 14:44:43.768262 3920 raft_consensus.cc:2454] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 705a4d341a2747acaf316c9f21438605 in term 0.
I20260923 14:44:43.768267 4052 raft_consensus.cc:2454] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 705a4d341a2747acaf316c9f21438605 in term 0.
I20260923 14:44:43.768733 3724 leader_election.cc:302] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c3dc0b0c264fc19ad348c0191071ec, 705a4d341a2747acaf316c9f21438605; no voters:
I20260923 14:44:43.769014 4122 raft_consensus.cc:2781] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:43.769100 4122 raft_consensus.cc:482] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:43.769165 4122 raft_consensus.cc:3037] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:43.770190 4122 raft_consensus.cc:504] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.770548 4122 leader_election.cc:288] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [CANDIDATE]: Term 1 election: Requested vote from peers b346c60329204db28c32c61ed8f198e7 (127.17.4.130:39175), 10c3dc0b0c264fc19ad348c0191071ec (127.17.4.131:37341)
I20260923 14:44:43.770892 3920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7407fc0e2a16478fa0a8a8a64f6f603f" candidate_uuid: "705a4d341a2747acaf316c9f21438605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b346c60329204db28c32c61ed8f198e7"
I20260923 14:44:43.770993 3920 raft_consensus.cc:3037] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:43.771893 4052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7407fc0e2a16478fa0a8a8a64f6f603f" candidate_uuid: "705a4d341a2747acaf316c9f21438605" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c3dc0b0c264fc19ad348c0191071ec"
I20260923 14:44:43.771999 4052 raft_consensus.cc:3037] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:43.772163 3920 raft_consensus.cc:2454] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 705a4d341a2747acaf316c9f21438605 in term 1.
I20260923 14:44:43.772495 3722 leader_election.cc:302] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 705a4d341a2747acaf316c9f21438605, b346c60329204db28c32c61ed8f198e7; no voters:
I20260923 14:44:43.772661 4122 raft_consensus.cc:2781] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:43.772898 4122 raft_consensus.cc:686] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [term 1 LEADER]: Becoming Leader. State: Replica: 705a4d341a2747acaf316c9f21438605, State: Running, Role: LEADER
I20260923 14:44:43.773253 4122 consensus_queue.cc:237] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } }
I20260923 14:44:43.773407 4052 raft_consensus.cc:2454] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 705a4d341a2747acaf316c9f21438605 in term 1.
I20260923 14:44:43.776696 3644 catalog_manager.cc:5495] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 reported cstate change: term changed from 0 to 1, leader changed from <none> to 705a4d341a2747acaf316c9f21438605 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "705a4d341a2747acaf316c9f21438605" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "705a4d341a2747acaf316c9f21438605" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 38941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 } health_report { overall_health: UNKNOWN } } }
I20260923 14:44:43.879408 4130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.875688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56400 (local address 127.17.4.129:38941)
0923 14:44:43.876112 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:43.876116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:43.876131 (+ 15us) server_negotiation.cc:407] Connection header received
0923 14:44:43.876203 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:43.876205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:43.876260 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:43.876361 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:43.876592 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.877124 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.877975 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:43.878206 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:43.878284 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:43.878580 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:43.878978 (+ 398us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:43.879107 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:43.879225 (+ 118us) server_negotiation.cc:299] Negotiation successful
0923 14:44:43.879258 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":89,"threads_started":1}
I20260923 14:44:43.885079 3920 raft_consensus.cc:1261] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 1 FOLLOWER]: Refusing update from remote peer 705a4d341a2747acaf316c9f21438605: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:43.885109 4052 raft_consensus.cc:1261] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 1 FOLLOWER]: Refusing update from remote peer 705a4d341a2747acaf316c9f21438605: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:43.885882 4126 consensus_queue.cc:1035] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b346c60329204db28c32c61ed8f198e7" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 39175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:43.886091 4122 consensus_queue.cc:1035] T 7407fc0e2a16478fa0a8a8a64f6f603f P 705a4d341a2747acaf316c9f21438605 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c3dc0b0c264fc19ad348c0191071ec" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 37341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:43.894124 4134 mvcc.cc:205] Tried to move back new op lower bound from 7332555505186115584 to 7332555504738041856. Current Snapshot: MvccSnapshot[applied={T|T < 7332555505186115584}]
I20260923 14:44:43.904402 3645 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:43.904564 3645 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:43.906936 3645 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d325d803cd8d4ff0b2e6e88ee8c5de7e: Sending DeleteTablet for 3 replicas of tablet 7407fc0e2a16478fa0a8a8a64f6f603f
I20260923 14:44:43.907730 3768 tablet_service.cc:1514] Processing DeleteTablet for tablet 7407fc0e2a16478fa0a8a8a64f6f603f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:43 UTC) from {username='slave'} at 127.0.0.1:36100
I20260923 14:44:43.907879 3900 tablet_service.cc:1514] Processing DeleteTablet for tablet 7407fc0e2a16478fa0a8a8a64f6f603f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:43 UTC) from {username='slave'} at 127.0.0.1:47762
I20260923 14:44:43.908365 4032 tablet_service.cc:1514] Processing DeleteTablet for tablet 7407fc0e2a16478fa0a8a8a64f6f603f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:43 UTC) from {username='slave'} at 127.0.0.1:51144
I20260923 14:44:43.908501 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3705
I20260923 14:44:43.908818 4144 tablet_replica.cc:330] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: stopping tablet replica
I20260923 14:44:43.909274 4144 raft_consensus.cc:2229] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:43.909567 4144 raft_consensus.cc:2258] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:43.910995 4144 ts_tablet_manager.cc:1905] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:43.911186 4145 tablet_replica.cc:330] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: stopping tablet replica
I20260923 14:44:43.911463 4145 raft_consensus.cc:2229] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:43.911741 4145 raft_consensus.cc:2258] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:43.912829 4145 ts_tablet_manager.cc:1905] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:43.914516 4144 ts_tablet_manager.cc:1918] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:43.914645 4144 log.cc:1196] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/7407fc0e2a16478fa0a8a8a64f6f603f
I20260923 14:44:43.914928 4145 ts_tablet_manager.cc:1918] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:43.914979 4144 ts_tablet_manager.cc:1939] T 7407fc0e2a16478fa0a8a8a64f6f603f P b346c60329204db28c32c61ed8f198e7: Deleting consensus metadata
I20260923 14:44:43.915031 4145 log.cc:1196] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/7407fc0e2a16478fa0a8a8a64f6f603f
I20260923 14:44:43.915303 4145 ts_tablet_manager.cc:1939] T 7407fc0e2a16478fa0a8a8a64f6f603f P 10c3dc0b0c264fc19ad348c0191071ec: Deleting consensus metadata
I20260923 14:44:43.916321 3630 catalog_manager.cc:4841] TS b346c60329204db28c32c61ed8f198e7 (127.17.4.130:39175): tablet 7407fc0e2a16478fa0a8a8a64f6f603f (table test-table [id=7329b04b4fba4ad98264606a37fc2af5]) successfully deleted
I20260923 14:44:43.916330 3632 catalog_manager.cc:4841] TS 10c3dc0b0c264fc19ad348c0191071ec (127.17.4.131:37341): tablet 7407fc0e2a16478fa0a8a8a64f6f603f (table test-table [id=7329b04b4fba4ad98264606a37fc2af5]) successfully deleted
W20260923 14:44:43.916741 3632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:38941 (error 108)
I20260923 14:44:43.916922 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3838
I20260923 14:44:43.922670 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3970
I20260923 14:44:43.922909 4147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:43.917610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:38941 (local address 127.0.0.1:56406)
0923 14:44:43.922698 (+ 5088us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:43.922784 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:38941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5001,"thread_start_us":51,"threads_started":1}
W20260923 14:44:43.923048 3632 catalog_manager.cc:4584] TS 705a4d341a2747acaf316c9f21438605 (127.17.4.129:38941): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7407fc0e2a16478fa0a8a8a64f6f603f: Network error: Client connection negotiation failed: client connection to 127.17.4.129:38941: connect: Connection refused (error 111)
I20260923 14:44:43.928243 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 3614
2026-09-23T14:44:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1516 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:43 dist-test-slave-54kg krb5kdc[4150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:43 dist-test-slave-54kg krb5kdc[4150](info): set up 2 sockets
Sep 23 14:44:43 dist-test-slave-54kg krb5kdc[4150](info): commencing operation
krb5kdc: starting...
W20260923 14:44:44.968935 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:44:45.087241 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:41457
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:41457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:45.195897 4163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:45.196182 4163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:45.196228 4163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:45.200225 4163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:45.200273 4163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:45.200294 4163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:45.200309 4163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:45.200325 4163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:45.205498 4163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:41457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:41457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:45.206490 4163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:45.207463 4163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:45.215488 4169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:45.215533 4171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.215690 4163 server_base.cc:1034] running on GCE node
W20260923 14:44:45.215507 4168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.216416 4163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:45.217450 4163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:45.218642 4163 hybrid_clock.cc:648] HybridClock initialized: now 1790174685218615 us; error 38 us; skew 500 ppm
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:45.221276 4163 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:44:45.222158 4163 webserver.cc:460] Webserver started at http://127.17.4.190:42525/ using document root <none> and password file <none>
I20260923 14:44:45.222712 4163 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:45.222801 4163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:45.223022 4163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:45.225044 4163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "17a1c640b3564171b979180423c10278"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "c5b9863d562b787fd67ed49e5d8698b7"
server_key_iv: "bb61e617093afa5287dc8065d8635d7e"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.225628 4163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "17a1c640b3564171b979180423c10278"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "c5b9863d562b787fd67ed49e5d8698b7"
server_key_iv: "bb61e617093afa5287dc8065d8635d7e"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.229214 4163 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:45.231509 4178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.232790 4163 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:45.232928 4163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "17a1c640b3564171b979180423c10278"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "c5b9863d562b787fd67ed49e5d8698b7"
server_key_iv: "bb61e617093afa5287dc8065d8635d7e"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.233038 4163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:45.244179 4163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:45.246784 4163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:45.246981 4163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:45.253759 4163 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:41457
I20260923 14:44:45.253819 4230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:41457 every 8 connection(s)
I20260923 14:44:45.254696 4163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:45.257313 4231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:45.262497 4231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: Bootstrap starting.
I20260923 14:44:45.262552 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4163
I20260923 14:44:45.262686 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:45.262971 17426 external_mini_cluster.cc:1428] Setting key ef93ac177c015255fc54feb477acb29d
I20260923 14:44:45.265317 4231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:45.266191 4231 log.cc:824] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:45.268271 4231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: No bootstrap required, opened a new log
I20260923 14:44:45.272127 4231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a1c640b3564171b979180423c10278" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41457 } }
I20260923 14:44:45.272369 4231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:45.272452 4231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a1c640b3564171b979180423c10278, State: Initialized, Role: FOLLOWER
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:45.272975 4231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a1c640b3564171b979180423c10278" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41457 } }
I20260923 14:44:45.273154 4231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:45.273224 4231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:45.273329 4231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:45.274183 4231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a1c640b3564171b979180423c10278" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41457 } }
I20260923 14:44:45.274515 4231 leader_election.cc:302] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17a1c640b3564171b979180423c10278; no voters:
I20260923 14:44:45.274840 4231 leader_election.cc:288] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:45.274915 4236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:45.275126 4236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [term 1 LEADER]: Becoming Leader. State: Replica: 17a1c640b3564171b979180423c10278, State: Running, Role: LEADER
I20260923 14:44:45.275468 4236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a1c640b3564171b979180423c10278" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41457 } }
I20260923 14:44:45.276113 4231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:45.276616 4236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1c640b3564171b979180423c10278. Latest consensus state: current_term: 1 leader_uuid: "17a1c640b3564171b979180423c10278" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a1c640b3564171b979180423c10278" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41457 } } }
I20260923 14:44:45.277415 4236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:45.277293 4237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17a1c640b3564171b979180423c10278" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a1c640b3564171b979180423c10278" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41457 } } }
I20260923 14:44:45.277719 4237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:45.279138 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.264432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48970 (local address 127.17.4.190:41457)
0923 14:44:45.264857 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:45.264875 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:45.264915 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:44:45.265816 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:45.265838 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:45.266255 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:45.266621 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:45.267411 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.268850 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.269684 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.270391 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.270538 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.273230 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:45.273239 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:45.273258 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:45.273310 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:45.275313 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.275818 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.275824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.275830 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.275959 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.276294 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.276305 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.276306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.276783 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:45.277682 (+ 899us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:45.277827 (+ 145us) server_negotiation.cc:299] Negotiation successful
0923 14:44:45.278141 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":112,"threads_started":1}
W20260923 14:44:45.281133 4252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:44:45.281225 4252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:44:45.281286 4245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:45.282033 4245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:45.287539 4245 catalog_manager.cc:1347] Generated new cluster ID: 8d4f2899a5fc42a7876ec7ee10637e8a
I20260923 14:44:45.287599 4245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:45.297300 4245 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:45.298435 4245 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:45.302386 4245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: Generated new TSK 0
I20260923 14:44:45.303094 4245 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.4.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
Entry for principal kudu/127.17.4.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab.
I20260923 14:44:45.330993 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:41457
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:45.442107 4257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:45.442358 4257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:45.442400 4257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:45.446404 4257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:45.446461 4257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:45.446573 4257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:45.451936 4257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.129.keytab
--principal=kudu/127.17.4.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:41457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:45.452939 4257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:45.453925 4257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:45.463311 4263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:45.463339 4265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.463384 4257 server_base.cc:1034] running on GCE node
W20260923 14:44:45.463320 4262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.464063 4257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:45.464639 4257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:45.465809 4257 hybrid_clock.cc:648] HybridClock initialized: now 1790174685465788 us; error 32 us; skew 500 ppm
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:45.468672 4257 init.cc:377] Logged in from keytab as kudu/127.17.4.129@KRBTEST.COM (short username kudu)
I20260923 14:44:45.469519 4257 webserver.cc:460] Webserver started at http://127.17.4.129:45097/ using document root <none> and password file <none>
I20260923 14:44:45.470033 4257 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:45.470090 4257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:45.470248 4257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:45.472282 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "77697c63ee284acc989c7ba4013772cd"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "a4ab98bc067ccdc2ace821e02ac7669e"
server_key_iv: "c4d75b839637c3021c3f323fef8b660d"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.472780 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "77697c63ee284acc989c7ba4013772cd"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "a4ab98bc067ccdc2ace821e02ac7669e"
server_key_iv: "c4d75b839637c3021c3f323fef8b660d"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.476568 4257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 14:44:45.478991 4272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.480224 4257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:45.480319 4257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "77697c63ee284acc989c7ba4013772cd"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "a4ab98bc067ccdc2ace821e02ac7669e"
server_key_iv: "c4d75b839637c3021c3f323fef8b660d"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.480407 4257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:45.492364 4257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:45.495527 4257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:45.495676 4257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:45.496282 4257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:45.497098 4257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:45.497146 4257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.497211 4257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:45.497241 4257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.505987 4257 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:34049
I20260923 14:44:45.506016 4385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:34049 every 8 connection(s)
I20260923 14:44:45.506878 4257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.129@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:45.516846 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4257
I20260923 14:44:45.516984 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:44:45.517331 17426 external_mini_cluster.cc:1428] Setting key 8e81b2962c56e7e886c20bca00ed4cb4
I20260923 14:44:45.520599 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.508614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:42787 (local address 127.17.4.190:41457)
0923 14:44:45.508752 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:45.508756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:45.509549 (+ 793us) server_negotiation.cc:407] Connection header received
0923 14:44:45.510871 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:45.510874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:45.510932 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:45.511049 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:45.512238 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.512781 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.513915 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.514165 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.514272 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.516688 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:45.516693 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:45.516701 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:45.516729 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:45.518458 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.519125 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.519127 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.519128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.519198 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.519580 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.519582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.519583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.519735 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:45.519876 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:45.520328 (+ 452us) server_negotiation.cc:299] Negotiation successful
0923 14:44:45.520438 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:44:45.521319 4388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.508971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:41457 (local address 127.17.4.129:42787)
0923 14:44:45.509400 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:45.509446 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:45.510664 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:45.511232 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:45.511238 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:45.511563 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:45.512102 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:45.512116 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.512918 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.512926 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:45.513788 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:45.513797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.514332 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.514336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:45.514486 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.514997 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:45.515012 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:45.516525 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:45.518591 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:45.518596 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:45.518606 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:45.519011 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:45.519294 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:45.519300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:45.519303 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:45.519489 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:45.519877 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:45.519884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:45.520108 (+ 224us) client_negotiation.cc:769] Sending connection context
0923 14:44:45.520291 (+ 183us) client_negotiation.cc:240] Negotiation successful
0923 14:44:45.520576 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
I20260923 14:44:45.522557 4386 heartbeater.cc:347] Connected to a master server at 127.17.4.190:41457
I20260923 14:44:45.522816 4386 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:45.523262 4386 heartbeater.cc:511] Master 127.17.4.190:41457 requested a full tablet report, sending...
I20260923 14:44:45.524933 4195 ts_manager.cc:194] Registered new tserver with Master: 77697c63ee284acc989c7ba4013772cd (127.17.4.129:34049)
I20260923 14:44:45.526539 4195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.129@KRBTEST.COM'} at 127.17.4.129:42787
WARNING: no policy specified for kudu/127.17.4.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
Entry for principal kudu/127.17.4.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab.
I20260923 14:44:45.545043 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:41457
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:45.656260 4391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:45.656497 4391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:45.656540 4391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:45.660774 4391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:45.660835 4391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:45.660892 4391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:45.666002 4391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.130.keytab
--principal=kudu/127.17.4.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:41457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:45.666950 4391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:45.668308 4391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:45.677707 4396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:45.677711 4397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.678118 4391 server_base.cc:1034] running on GCE node
W20260923 14:44:45.677773 4399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.678608 4391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:45.679248 4391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:45.680434 4391 hybrid_clock.cc:648] HybridClock initialized: now 1790174685680406 us; error 38 us; skew 500 ppm
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:45.683415 4391 init.cc:377] Logged in from keytab as kudu/127.17.4.130@KRBTEST.COM (short username kudu)
I20260923 14:44:45.684361 4391 webserver.cc:460] Webserver started at http://127.17.4.130:41405/ using document root <none> and password file <none>
I20260923 14:44:45.684928 4391 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:45.685007 4391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:45.685180 4391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:45.687170 4391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "efaef607c5f74db5b0e7173e6e6e7817"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "7b9d658f8e88f2183ba1026a36a86e5f"
server_key_iv: "387af13d5928807986789482955edadc"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.687687 4391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "efaef607c5f74db5b0e7173e6e6e7817"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "7b9d658f8e88f2183ba1026a36a86e5f"
server_key_iv: "387af13d5928807986789482955edadc"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.691684 4391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 14:44:45.694217 4406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.695536 4391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 14:44:45.695672 4391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "efaef607c5f74db5b0e7173e6e6e7817"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "7b9d658f8e88f2183ba1026a36a86e5f"
server_key_iv: "387af13d5928807986789482955edadc"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.695852 4391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:45.729625 4391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:45.733011 4391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:45.733235 4391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:45.733812 4391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:45.734649 4391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:45.734695 4391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.734762 4391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:45.734804 4391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.743501 4391 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:33487
I20260923 14:44:45.743588 4519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:33487 every 8 connection(s)
I20260923 14:44:45.744450 4391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:44:45.751267 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4391
I20260923 14:44:45.751374 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:44:45.751673 17426 external_mini_cluster.cc:1428] Setting key 51b74fa5a4a2d832118b28401c824475
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.130@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:45.758440 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.746222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:43941 (local address 127.17.4.190:41457)
0923 14:44:45.746378 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:45.746382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:45.747224 (+ 842us) server_negotiation.cc:407] Connection header received
0923 14:44:45.748707 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:45.748711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:45.748770 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:45.748897 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:45.750054 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.750575 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.751902 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.752130 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.752244 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.754895 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:45.754898 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:45.754900 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:45.754923 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:45.756422 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.756937 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.756947 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.756949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.757020 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.757361 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.757366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.757368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.757543 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:45.757658 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:45.758150 (+ 492us) server_negotiation.cc:299] Negotiation successful
0923 14:44:45.758279 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 14:44:45.759197 4522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.746599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:41457 (local address 127.17.4.130:43941)
0923 14:44:45.747074 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:45.747117 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:45.748453 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:45.749076 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:45.749083 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:45.749448 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:45.749900 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:45.749912 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.750723 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.750727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:45.751742 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:45.751756 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.752283 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.752287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:45.752520 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.753289 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:45.753304 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:45.754723 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:45.756543 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:45.756549 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:45.756563 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:45.756820 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:45.757118 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:45.757121 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:45.757123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:45.757263 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:45.757656 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:45.757663 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:45.757903 (+ 240us) client_negotiation.cc:769] Sending connection context
0923 14:44:45.758101 (+ 198us) client_negotiation.cc:240] Negotiation successful
0923 14:44:45.758415 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":117,"threads_started":1}
I20260923 14:44:45.760346 4520 heartbeater.cc:347] Connected to a master server at 127.17.4.190:41457
I20260923 14:44:45.760588 4520 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.4.131@KRBTEST.COM; defaulting to no policy
I20260923 14:44:45.761104 4520 heartbeater.cc:511] Master 127.17.4.190:41457 requested a full tablet report, sending...
I20260923 14:44:45.762251 4195 ts_manager.cc:194] Registered new tserver with Master: efaef607c5f74db5b0e7173e6e6e7817 (127.17.4.130:33487)
I20260923 14:44:45.762838 4195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.130@KRBTEST.COM'} at 127.17.4.130:43941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
Entry for principal kudu/127.17.4.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab.
I20260923 14:44:45.779444 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:41457
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:45.891053 4525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:45.891325 4525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:45.891369 4525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:45.895473 4525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:45.895532 4525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:45.895592 4525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:45.900982 4525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.131.keytab
--principal=kudu/127.17.4.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:41457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:45.901983 4525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:45.902940 4525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:45.912516 4533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:45.912528 4530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.912609 4525 server_base.cc:1034] running on GCE node
W20260923 14:44:45.912528 4531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:45.913240 4525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:45.913895 4525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:45.915117 4525 hybrid_clock.cc:648] HybridClock initialized: now 1790174685915095 us; error 35 us; skew 500 ppm
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:45.918015 4525 init.cc:377] Logged in from keytab as kudu/127.17.4.131@KRBTEST.COM (short username kudu)
I20260923 14:44:45.918957 4525 webserver.cc:460] Webserver started at http://127.17.4.131:40341/ using document root <none> and password file <none>
I20260923 14:44:45.919503 4525 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:45.919615 4525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:45.919910 4525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:45.921864 4525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "a5782084f2ae4dc9a6147d5284536fcd"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "b3b1f3beb813f0f20cd166554d9ea23d"
server_key_iv: "8ea7303d9554c9bc5c5309fdf9754920"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.922391 4525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "a5782084f2ae4dc9a6147d5284536fcd"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "b3b1f3beb813f0f20cd166554d9ea23d"
server_key_iv: "8ea7303d9554c9bc5c5309fdf9754920"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.926136 4525 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:45.928507 4540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.929697 4525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:45.929842 4525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "a5782084f2ae4dc9a6147d5284536fcd"
format_stamp: "Formatted at 2026-09-23 14:44:45 on dist-test-slave-54kg"
server_key: "b3b1f3beb813f0f20cd166554d9ea23d"
server_key_iv: "8ea7303d9554c9bc5c5309fdf9754920"
server_key_version: "encryptionkey@0"
I20260923 14:44:45.929953 4525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:45.941545 4525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:45.944864 4525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:45.945075 4525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:45.945888 4525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:45.946775 4525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:45.946851 4525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.946921 4525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:45.946971 4525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:45.955967 4525 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:43673
I20260923 14:44:45.956019 4653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:43673 every 8 connection(s)
I20260923 14:44:45.956897 4525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:45.966063 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4525
I20260923 14:44:45.966220 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:44:45.966514 17426 external_mini_cluster.cc:1428] Setting key 999bd9949239dad826fb4c7f67b48817
Sep 23 14:44:45 dist-test-slave-54kg krb5kdc[4150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.131@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:44:45.970849 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.958684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:48433 (local address 127.17.4.190:41457)
0923 14:44:45.958828 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:45.958832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:45.959596 (+ 764us) server_negotiation.cc:407] Connection header received
0923 14:44:45.961016 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:45.961020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:45.961083 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:45.961191 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:45.962420 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.962957 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.964233 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.964465 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.964579 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.967132 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:45.967136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:45.967138 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:45.967170 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:45.968813 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.969327 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.969330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.969332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.969421 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.969786 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.969790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.969791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.969977 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:45.970087 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:45.970574 (+ 487us) server_negotiation.cc:299] Negotiation successful
0923 14:44:45.970692 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 14:44:45.971663 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.958983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:41457 (local address 127.17.4.131:48433)
0923 14:44:45.959437 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:45.959480 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:45.960788 (+ 1308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:45.961404 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:45.961410 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:45.961775 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:45.962238 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:45.962253 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.963089 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.963098 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:45.964096 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:45.964107 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.964621 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.964624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:45.964797 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.965388 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:44:45.965403 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:45.966956 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:45.968930 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:45.968936 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:45.968950 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:45.969208 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:45.969520 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:44:45.969523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:44:45.969525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:44:45.969666 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:44:45.970087 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:45.970094 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:45.970341 (+ 247us) client_negotiation.cc:769] Sending connection context
0923 14:44:45.970534 (+ 193us) client_negotiation.cc:240] Negotiation successful
0923 14:44:45.970863 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":109,"threads_started":1}
I20260923 14:44:45.972998 4654 heartbeater.cc:347] Connected to a master server at 127.17.4.190:41457
I20260923 14:44:45.973263 4654 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:45.973747 4654 heartbeater.cc:511] Master 127.17.4.190:41457 requested a full tablet report, sending...
I20260923 14:44:45.974746 4195 ts_manager.cc:194] Registered new tserver with Master: a5782084f2ae4dc9a6147d5284536fcd (127.17.4.131:43673)
I20260923 14:44:45.975270 4195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.4.131@KRBTEST.COM'} at 127.17.4.131:48433
I20260923 14:44:45.980700 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:45.989885 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:45.982726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48980 (local address 127.17.4.190:41457)
0923 14:44:45.982846 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:45.982849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:45.983034 (+ 185us) server_negotiation.cc:407] Connection header received
0923 14:44:45.983143 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:45.983145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:45.983185 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:45.983266 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:45.984050 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.984593 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.985473 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:45.985683 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:45.985765 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:45.987189 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:45.987192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:45.987194 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:45.987211 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:45.988506 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.988874 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.988877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.988878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.988946 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:45.989187 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:45.989189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:45.989190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:45.989395 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:45.989495 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:45.989679 (+ 184us) server_negotiation.cc:299] Negotiation successful
0923 14:44:45.989768 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:44:45.992795 4195 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:45.995822 4195 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:46.010195 4669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.004768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:43673 (local address 127.0.0.1:34130)
0923 14:44:46.005270 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.005284 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.005353 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.006240 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.006243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.006263 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.006349 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.006355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.007731 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.007734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.008672 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.008683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.009575 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.009578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.009686 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.009729 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.009852 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.009993 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":52,"thread_start_us":96,"threads_started":1}
I20260923 14:44:46.010176 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.005191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34130 (local address 127.17.4.131:43673)
0923 14:44:46.005536 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.005545 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.005567 (+ 22us) server_negotiation.cc:407] Connection header received
0923 14:44:46.005660 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.005666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.005867 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.006078 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.006485 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.007603 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.008800 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.009445 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.009574 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.009760 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.009890 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.009993 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":160,"threads_started":1}
I20260923 14:44:46.010215 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.004044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34049 (local address 127.0.0.1:57920)
0923 14:44:46.004368 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.004412 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.005094 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.005690 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.005696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.005720 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.005858 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.005864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.007070 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.007076 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.008508 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.008519 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.009621 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.009625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.009735 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.009761 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.009821 (+ 60us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.009999 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260923 14:44:46.010354 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.004350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:33487 (local address 127.0.0.1:56560)
0923 14:44:46.004808 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.004824 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.004946 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.006064 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.006067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.006085 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.006181 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.006189 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.007670 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.007675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.008897 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.008907 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.010003 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.010006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.010098 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.010126 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.010175 (+ 49us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.010245 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":29,"thread_start_us":78,"threads_started":1}
I20260923 14:44:46.011116 4668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.004690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56560 (local address 127.17.4.130:33487)
0923 14:44:46.005578 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.005591 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.005616 (+ 25us) server_negotiation.cc:407] Connection header received
0923 14:44:46.005687 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.005691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.005895 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.006078 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.006292 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.007506 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.009032 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.009872 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.010732 (+ 860us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.010853 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.010894 (+ 41us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.010966 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":125,"threads_started":1}
I20260923 14:44:46.011127 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.004189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57920 (local address 127.17.4.129:34049)
0923 14:44:46.005147 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.005163 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.005191 (+ 28us) server_negotiation.cc:407] Connection header received
0923 14:44:46.005285 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.005292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.005516 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.005681 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.005992 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.006936 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.008643 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.009473 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.010653 (+ 1180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.010807 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.010859 (+ 52us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.010956 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":98,"threads_started":1}
I20260923 14:44:46.013662 4588 tablet_service.cc:1467] Processing CreateTablet for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c (DEFAULT_TABLE table=test-table [id=e4f2f27ca47f41cc9a8999ceb677067a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:46.013815 4454 tablet_service.cc:1467] Processing CreateTablet for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c (DEFAULT_TABLE table=test-table [id=e4f2f27ca47f41cc9a8999ceb677067a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:46.013818 4320 tablet_service.cc:1467] Processing CreateTablet for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c (DEFAULT_TABLE table=test-table [id=e4f2f27ca47f41cc9a8999ceb677067a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:46.014711 4588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:46.014833 4320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:46.014833 4454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:46.021148 4671 tablet_bootstrap.cc:492] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Bootstrap starting.
I20260923 14:44:46.022414 4673 tablet_bootstrap.cc:492] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Bootstrap starting.
I20260923 14:44:46.022816 4672 tablet_bootstrap.cc:492] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: Bootstrap starting.
I20260923 14:44:46.023638 4671 tablet_bootstrap.cc:654] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:46.024762 4671 log.cc:824] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:46.024839 4672 tablet_bootstrap.cc:654] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:46.025136 4673 tablet_bootstrap.cc:654] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:46.025789 4672 log.cc:824] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:46.025969 4673 log.cc:824] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:46.026912 4671 tablet_bootstrap.cc:492] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: No bootstrap required, opened a new log
I20260923 14:44:46.027107 4671 ts_tablet_manager.cc:1397] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 14:44:46.027618 4672 tablet_bootstrap.cc:492] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: No bootstrap required, opened a new log
I20260923 14:44:46.027838 4672 ts_tablet_manager.cc:1397] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260923 14:44:46.027910 4673 tablet_bootstrap.cc:492] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: No bootstrap required, opened a new log
I20260923 14:44:46.028080 4673 ts_tablet_manager.cc:1397] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:44:46.030915 4672 raft_consensus.cc:348] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.031132 4672 raft_consensus.cc:374] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:46.031165 4672 raft_consensus.cc:729] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77697c63ee284acc989c7ba4013772cd, State: Initialized, Role: FOLLOWER
I20260923 14:44:46.031014 4671 raft_consensus.cc:348] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.031329 4671 raft_consensus.cc:374] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:46.031388 4671 raft_consensus.cc:729] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5782084f2ae4dc9a6147d5284536fcd, State: Initialized, Role: FOLLOWER
I20260923 14:44:46.031685 4672 consensus_queue.cc:260] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.031836 4671 consensus_queue.cc:260] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.031821 4673 raft_consensus.cc:348] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.032114 4673 raft_consensus.cc:374] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:46.032202 4673 raft_consensus.cc:729] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efaef607c5f74db5b0e7173e6e6e7817, State: Initialized, Role: FOLLOWER
I20260923 14:44:46.032459 4386 heartbeater.cc:503] Master 127.17.4.190:41457 was elected leader, sending a full tablet report...
I20260923 14:44:46.032814 4672 ts_tablet_manager.cc:1428] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:44:46.032858 4671 ts_tablet_manager.cc:1428] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 14:44:46.033234 4654 heartbeater.cc:503] Master 127.17.4.190:41457 was elected leader, sending a full tablet report...
I20260923 14:44:46.033340 4673 consensus_queue.cc:260] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.034051 4520 heartbeater.cc:503] Master 127.17.4.190:41457 was elected leader, sending a full tablet report...
I20260923 14:44:46.034516 4673 ts_tablet_manager.cc:1428] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 14:44:46.035046 4679 raft_consensus.cc:482] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:46.035194 4679 raft_consensus.cc:504] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.036980 4679 leader_election.cc:288] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5782084f2ae4dc9a6147d5284536fcd (127.17.4.131:43673), efaef607c5f74db5b0e7173e6e6e7817 (127.17.4.130:33487)
I20260923 14:44:46.041793 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.036778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:41133 (local address 127.17.4.131:43673)
0923 14:44:46.036889 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.036894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.037390 (+ 496us) server_negotiation.cc:407] Connection header received
0923 14:44:46.037636 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.037640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.037691 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.037765 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.038195 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.038939 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.040513 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.041200 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.041324 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.041395 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.041579 (+ 184us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.041650 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:44:46.041817 4681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.036650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:43673 (local address 127.17.4.129:41133)
0923 14:44:46.037301 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.037317 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.037509 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.037898 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.037901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.037921 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.038048 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.038055 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.039050 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.039054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.040383 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.040394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.041332 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.041336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.041451 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.041481 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.041564 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.041640 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":113,"threads_started":1}
I20260923 14:44:46.041925 4668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.037299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:48987 (local address 127.17.4.130:33487)
0923 14:44:46.037420 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.037424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.037818 (+ 394us) server_negotiation.cc:407] Connection header received
0923 14:44:46.038003 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.038009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.038054 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.038119 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.038564 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.039296 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.040685 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.041327 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.041441 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.041485 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.041745 (+ 260us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.041815 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 14:44:46.042429 4682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.037232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:33487 (local address 127.17.4.129:48987)
0923 14:44:46.037742 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.037755 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.037892 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.038227 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.038230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.038258 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.038428 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.038438 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.039436 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.039440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.040577 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.040583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.041466 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.041470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.041604 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.041628 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.042239 (+ 611us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.042323 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":2,"thread_start_us":89,"threads_started":1}
I20260923 14:44:46.042462 4608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbec8aab5c54d6794e6066fd5ca6c6c" candidate_uuid: "77697c63ee284acc989c7ba4013772cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5782084f2ae4dc9a6147d5284536fcd" is_pre_election: true
I20260923 14:44:46.042773 4608 raft_consensus.cc:2454] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77697c63ee284acc989c7ba4013772cd in term 0.
I20260923 14:44:46.043056 4474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbec8aab5c54d6794e6066fd5ca6c6c" candidate_uuid: "77697c63ee284acc989c7ba4013772cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaef607c5f74db5b0e7173e6e6e7817" is_pre_election: true
I20260923 14:44:46.043272 4275 leader_election.cc:302] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77697c63ee284acc989c7ba4013772cd, a5782084f2ae4dc9a6147d5284536fcd; no voters:
I20260923 14:44:46.043311 4474 raft_consensus.cc:2454] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77697c63ee284acc989c7ba4013772cd in term 0.
I20260923 14:44:46.043579 4679 raft_consensus.cc:2781] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:46.043684 4679 raft_consensus.cc:482] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:46.043743 4679 raft_consensus.cc:3037] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:46.044777 4679 raft_consensus.cc:504] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.045130 4679 leader_election.cc:288] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [CANDIDATE]: Term 1 election: Requested vote from peers a5782084f2ae4dc9a6147d5284536fcd (127.17.4.131:43673), efaef607c5f74db5b0e7173e6e6e7817 (127.17.4.130:33487)
I20260923 14:44:46.045475 4608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbec8aab5c54d6794e6066fd5ca6c6c" candidate_uuid: "77697c63ee284acc989c7ba4013772cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5782084f2ae4dc9a6147d5284536fcd"
I20260923 14:44:46.045475 4474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cbec8aab5c54d6794e6066fd5ca6c6c" candidate_uuid: "77697c63ee284acc989c7ba4013772cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaef607c5f74db5b0e7173e6e6e7817"
I20260923 14:44:46.045595 4474 raft_consensus.cc:3037] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:46.045595 4608 raft_consensus.cc:3037] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:46.046866 4608 raft_consensus.cc:2454] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77697c63ee284acc989c7ba4013772cd in term 1.
I20260923 14:44:46.046866 4474 raft_consensus.cc:2454] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77697c63ee284acc989c7ba4013772cd in term 1.
I20260923 14:44:46.047199 4276 leader_election.cc:302] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 77697c63ee284acc989c7ba4013772cd, a5782084f2ae4dc9a6147d5284536fcd, efaef607c5f74db5b0e7173e6e6e7817; no voters:
I20260923 14:44:46.047407 4679 raft_consensus.cc:2781] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:46.047510 4679 raft_consensus.cc:686] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 1 LEADER]: Becoming Leader. State: Replica: 77697c63ee284acc989c7ba4013772cd, State: Running, Role: LEADER
I20260923 14:44:46.047881 4679 consensus_queue.cc:237] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } }
I20260923 14:44:46.050870 4193 catalog_manager.cc:5495] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 77697c63ee284acc989c7ba4013772cd (127.17.4.129). New cstate: current_term: 1 leader_uuid: "77697c63ee284acc989c7ba4013772cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77697c63ee284acc989c7ba4013772cd" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 34049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 } health_report { overall_health: UNKNOWN } } }
I20260923 14:44:46.073282 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.069763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57932 (local address 127.17.4.129:34049)
0923 14:44:46.069884 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.069889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.069903 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:44:46.070019 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.070021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.070073 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.070186 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:46.070437 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.070927 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.071806 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.072018 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.072128 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.072444 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:46.072860 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:46.072990 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.073050 (+ 60us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.073106 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260923 14:44:46.079490 4608 raft_consensus.cc:1261] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 1 FOLLOWER]: Refusing update from remote peer 77697c63ee284acc989c7ba4013772cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:46.079490 4474 raft_consensus.cc:1261] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 1 FOLLOWER]: Refusing update from remote peer 77697c63ee284acc989c7ba4013772cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:46.080228 4679 consensus_queue.cc:1035] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efaef607c5f74db5b0e7173e6e6e7817" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 33487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:46.080435 4677 consensus_queue.cc:1035] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5782084f2ae4dc9a6147d5284536fcd" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 43673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:46.087642 4685 mvcc.cc:205] Tried to move back new op lower bound from 7332555514173845504 to 7332555514054774784. Current Snapshot: MvccSnapshot[applied={T|T < 7332555514173845504}]
I20260923 14:44:46.088418 4686 mvcc.cc:205] Tried to move back new op lower bound from 7332555514173845504 to 7332555514054774784. Current Snapshot: MvccSnapshot[applied={T|T < 7332555514173845504}]
I20260923 14:44:46.095978 4193 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:46.096164 4193 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:46.098436 4193 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 17a1c640b3564171b979180423c10278: Sending DeleteTablet for 3 replicas of tablet 0cbec8aab5c54d6794e6066fd5ca6c6c
I20260923 14:44:46.099169 4320 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:46 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:57920
I20260923 14:44:46.099254 4454 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:46 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:56560
I20260923 14:44:46.099661 4695 tablet_replica.cc:330] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd: stopping tablet replica
I20260923 14:44:46.099714 4696 tablet_replica.cc:330] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: stopping tablet replica
I20260923 14:44:46.099776 4588 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:46 UTC) from {username='kudu', principal='kudu/127.17.4.190@KRBTEST.COM'} at 127.0.0.1:34130
I20260923 14:44:46.100103 4695 raft_consensus.cc:2229] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 1 LEADER]: Raft consensus shutting down.
I20260923 14:44:46.100119 4696 raft_consensus.cc:2229] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:46.100464 4696 raft_consensus.cc:2258] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:46.100535 4695 raft_consensus.cc:2258] T 0cbec8aab5c54d6794e6066fd5ca6c6c P 77697c63ee284acc989c7ba4013772cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:46.101006 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4257
I20260923 14:44:46.101744 4697 tablet_replica.cc:330] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: stopping tablet replica
I20260923 14:44:46.102028 4697 raft_consensus.cc:2229] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:46.102299 4697 raft_consensus.cc:2258] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:46.102957 4696 ts_tablet_manager.cc:1905] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:46.104180 4697 ts_tablet_manager.cc:1905] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:46.105762 4696 ts_tablet_manager.cc:1918] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:46.105875 4696 log.cc:1196] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/0cbec8aab5c54d6794e6066fd5ca6c6c
I20260923 14:44:46.106208 4696 ts_tablet_manager.cc:1939] T 0cbec8aab5c54d6794e6066fd5ca6c6c P efaef607c5f74db5b0e7173e6e6e7817: Deleting consensus metadata
I20260923 14:44:46.107307 4182 catalog_manager.cc:4841] TS efaef607c5f74db5b0e7173e6e6e7817 (127.17.4.130:33487): tablet 0cbec8aab5c54d6794e6066fd5ca6c6c (table test-table [id=e4f2f27ca47f41cc9a8999ceb677067a]) successfully deleted
I20260923 14:44:46.107512 4697 ts_tablet_manager.cc:1918] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:46.107611 4697 log.cc:1196] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/0cbec8aab5c54d6794e6066fd5ca6c6c
I20260923 14:44:46.107971 4697 ts_tablet_manager.cc:1939] T 0cbec8aab5c54d6794e6066fd5ca6c6c P a5782084f2ae4dc9a6147d5284536fcd: Deleting consensus metadata
I20260923 14:44:46.108927 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4391
W20260923 14:44:46.108913 4181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:34049 (error 108)
I20260923 14:44:46.110989 4181 catalog_manager.cc:4841] TS a5782084f2ae4dc9a6147d5284536fcd (127.17.4.131:43673): tablet 0cbec8aab5c54d6794e6066fd5ca6c6c (table test-table [id=e4f2f27ca47f41cc9a8999ceb677067a]) successfully deleted
I20260923 14:44:46.111167 4669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.110853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:34049 (local address 127.0.0.1:57946)
0923 14:44:46.110982 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.111049 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:34049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 14:44:46.111337 4181 catalog_manager.cc:4584] TS 77697c63ee284acc989c7ba4013772cd (127.17.4.129:34049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0cbec8aab5c54d6794e6066fd5ca6c6c: Network error: Client connection negotiation failed: client connection to 127.17.4.129:34049: connect: Connection refused (error 111)
I20260923 14:44:46.115063 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4525
I20260923 14:44:46.120596 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4163
2026-09-23T14:44:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2193 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-23T14:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:46Z Disabled control of system clock
I20260923 14:44:46.150933 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36303
--webserver_interface=127.17.4.190
--webserver_port=0
--builtin_ntp_servers=127.17.4.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:36303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 14:44:46.258280 4702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:46.258543 4702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:46.258577 4702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:46.262642 4702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:46.262704 4702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:46.262720 4702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:46.262737 4702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:46.262753 4702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:46.267578 4702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:36303
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:36303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:46.268771 4702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:46.270126 4702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:46.278544 4707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:46.278688 4702 server_base.cc:1034] running on GCE node
W20260923 14:44:46.278527 4708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:46.278506 4710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:46.279397 4702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:46.280491 4702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:46.281651 4702 hybrid_clock.cc:648] HybridClock initialized: now 1790174686281634 us; error 29 us; skew 500 ppm
I20260923 14:44:46.283404 4702 webserver.cc:460] Webserver started at http://127.17.4.190:33935/ using document root <none> and password file <none>
I20260923 14:44:46.284034 4702 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:46.284102 4702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:46.284320 4702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:46.286299 4702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "eac68e8cea5e45fd94a2f1690df2f772"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "e7d37b89b8eb234fd9c671cc88aab2ff"
server_key_iv: "75789e77f5e40d33d892ff87cd59d2c7"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.286849 4702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "eac68e8cea5e45fd94a2f1690df2f772"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "e7d37b89b8eb234fd9c671cc88aab2ff"
server_key_iv: "75789e77f5e40d33d892ff87cd59d2c7"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.290380 4702 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 14:44:46.292747 4716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.293921 4702 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:46.294062 4702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "eac68e8cea5e45fd94a2f1690df2f772"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "e7d37b89b8eb234fd9c671cc88aab2ff"
server_key_iv: "75789e77f5e40d33d892ff87cd59d2c7"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.294173 4702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:46.319634 4702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:46.320375 4702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:46.320578 4702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:46.327356 4702 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:36303
I20260923 14:44:46.327391 4768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:36303 every 8 connection(s)
I20260923 14:44:46.328308 4702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:46.331241 4769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:46.336529 4769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772: Bootstrap starting.
I20260923 14:44:46.336527 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4702
I20260923 14:44:46.336709 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:46.337023 17426 external_mini_cluster.cc:1428] Setting key cdf951a392c10965f3ec5be6a28098d5
I20260923 14:44:46.339258 4769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:46.340147 4769 log.cc:824] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:46.342191 4769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772: No bootstrap required, opened a new log
I20260923 14:44:46.346459 4769 raft_consensus.cc:348] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac68e8cea5e45fd94a2f1690df2f772" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36303 } }
I20260923 14:44:46.346720 4769 raft_consensus.cc:374] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:46.346765 4769 raft_consensus.cc:729] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac68e8cea5e45fd94a2f1690df2f772, State: Initialized, Role: FOLLOWER
I20260923 14:44:46.347198 4769 consensus_queue.cc:260] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac68e8cea5e45fd94a2f1690df2f772" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36303 } }
I20260923 14:44:46.347345 4769 raft_consensus.cc:388] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:46.347409 4769 raft_consensus.cc:482] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:46.347513 4769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:46.347528 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.338472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45192 (local address 127.17.4.190:36303)
0923 14:44:46.339136 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.339157 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.339201 (+ 44us) server_negotiation.cc:407] Connection header received
0923 14:44:46.340068 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.340099 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.340589 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.340897 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:46.341316 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.342783 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.343717 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.344444 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.344601 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.345485 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:46.345493 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:46.345512 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:46.346013 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:46.346095 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:46.346122 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:46.346217 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.346362 (+ 145us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.346611 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":107,"threads_started":1}
I20260923 14:44:46.348436 4769 raft_consensus.cc:504] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac68e8cea5e45fd94a2f1690df2f772" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36303 } }
I20260923 14:44:46.348810 4769 leader_election.cc:302] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eac68e8cea5e45fd94a2f1690df2f772; no voters:
I20260923 14:44:46.349126 4769 leader_election.cc:288] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:46.349232 4774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:46.349494 4774 raft_consensus.cc:686] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [term 1 LEADER]: Becoming Leader. State: Replica: eac68e8cea5e45fd94a2f1690df2f772, State: Running, Role: LEADER
I20260923 14:44:46.349862 4774 consensus_queue.cc:237] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac68e8cea5e45fd94a2f1690df2f772" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36303 } }
I20260923 14:44:46.350317 4769 sys_catalog.cc:564] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:46.351447 4776 sys_catalog.cc:455] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eac68e8cea5e45fd94a2f1690df2f772" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac68e8cea5e45fd94a2f1690df2f772" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36303 } } }
I20260923 14:44:46.351570 4776 sys_catalog.cc:458] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:46.351859 4775 sys_catalog.cc:455] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eac68e8cea5e45fd94a2f1690df2f772. Latest consensus state: current_term: 1 leader_uuid: "eac68e8cea5e45fd94a2f1690df2f772" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eac68e8cea5e45fd94a2f1690df2f772" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 36303 } } }
I20260923 14:44:46.352062 4775 sys_catalog.cc:458] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:46.352094 4783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:46.355014 4783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:46.359860 4783 catalog_manager.cc:1347] Generated new cluster ID: d759ba999e4945709bc510fec241f6d1
I20260923 14:44:46.359922 4783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:46.377779 4783 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:46.378949 4783 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:46.390095 4783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772: Generated new TSK 0
I20260923 14:44:46.390859 4783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:46.397369 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.129:0
--local_ip_for_outbound_sockets=127.17.4.129
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36303
--builtin_ntp_servers=127.17.4.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 14:44:46.508280 4793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:46.508543 4793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:46.508612 4793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:46.512503 4793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:46.512576 4793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:46.512666 4793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.129
I20260923 14:44:46.517282 4793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.4.129
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.129
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:46.518272 4793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:46.519619 4793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:46.528904 4799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:46.529001 4793 server_base.cc:1034] running on GCE node
W20260923 14:44:46.528921 4798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:46.528903 4801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:46.529615 4793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:46.530169 4793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:46.531360 4793 hybrid_clock.cc:648] HybridClock initialized: now 1790174686531351 us; error 32 us; skew 500 ppm
I20260923 14:44:46.533210 4793 webserver.cc:460] Webserver started at http://127.17.4.129:45661/ using document root <none> and password file <none>
I20260923 14:44:46.533763 4793 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:46.533852 4793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:46.534077 4793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:46.536114 4793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data/instance:
uuid: "064361e5d1a34acb84f26bd44f6b6b83"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "8920957a197ff8ba2b7eff7a9ff441ef"
server_key_iv: "f41a5b36f6e31d5c19fa1e88301ac3b0"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.536653 4793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance:
uuid: "064361e5d1a34acb84f26bd44f6b6b83"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "8920957a197ff8ba2b7eff7a9ff441ef"
server_key_iv: "f41a5b36f6e31d5c19fa1e88301ac3b0"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.540195 4793 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:44:46.542508 4807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.543726 4793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:46.543869 4793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal
uuid: "064361e5d1a34acb84f26bd44f6b6b83"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "8920957a197ff8ba2b7eff7a9ff441ef"
server_key_iv: "f41a5b36f6e31d5c19fa1e88301ac3b0"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.543954 4793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:46.568564 4793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:46.569185 4793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:46.569329 4793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:46.569836 4793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:46.570710 4793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:46.570756 4793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.570793 4793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:46.570815 4793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.579674 4793 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.129:41275
I20260923 14:44:46.579720 4920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.129:41275 every 8 connection(s)
I20260923 14:44:46.580523 4793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/data/info.pb
I20260923 14:44:46.583459 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4793
I20260923 14:44:46.583590 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-0/wal/instance
I20260923 14:44:46.583937 17426 external_mini_cluster.cc:1428] Setting key a30abf503355d2900154d550b5de6bc5
I20260923 14:44:46.585978 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.130:0
--local_ip_for_outbound_sockets=127.17.4.130
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36303
--builtin_ntp_servers=127.17.4.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 14:44:46.591097 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.582254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:39175 (local address 127.17.4.190:36303)
0923 14:44:46.582397 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.582400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.583406 (+ 1006us) server_negotiation.cc:407] Connection header received
0923 14:44:46.585218 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.585222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.585281 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.585361 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:46.586375 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.587248 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.589043 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.589262 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.589350 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.590657 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:46.590660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:46.590662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:46.590672 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:46.590690 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:46.590698 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:46.590753 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.590942 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.590989 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 14:44:46.592442 4923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.582639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36303 (local address 127.17.4.129:39175)
0923 14:44:46.583257 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.583296 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.584987 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.585569 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.585577 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.585662 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:46.586220 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.586252 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.587400 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.587407 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.588923 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.588938 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.589432 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.589439 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.589670 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.590349 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:46.590353 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:46.590413 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:46.590502 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:46.590783 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:46.590796 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:46.590805 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.590941 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.591290 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":98,"threads_started":1}
I20260923 14:44:46.593732 4921 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36303
I20260923 14:44:46.593963 4921 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:46.594499 4921 heartbeater.cc:511] Master 127.17.4.190:36303 requested a full tablet report, sending...
I20260923 14:44:46.596000 4733 ts_manager.cc:194] Registered new tserver with Master: 064361e5d1a34acb84f26bd44f6b6b83 (127.17.4.129:41275)
I20260923 14:44:46.597152 4733 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.129:39175
W20260923 14:44:46.694555 4924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:46.694854 4924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:46.694926 4924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:46.699117 4924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:46.699203 4924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:46.699285 4924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.130
I20260923 14:44:46.703979 4924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.4.130
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.130
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:46.704980 4924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:46.706305 4924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:46.715689 4932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:46.715854 4929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:46.715834 4930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:46.715909 4924 server_base.cc:1034] running on GCE node
I20260923 14:44:46.716459 4924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:46.717036 4924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:46.718205 4924 hybrid_clock.cc:648] HybridClock initialized: now 1790174686718194 us; error 41 us; skew 500 ppm
I20260923 14:44:46.720033 4924 webserver.cc:460] Webserver started at http://127.17.4.130:45599/ using document root <none> and password file <none>
I20260923 14:44:46.720619 4924 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:46.720710 4924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:46.720932 4924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:46.722880 4924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data/instance:
uuid: "704e7c429fa9416bb3f93981bd498be8"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "8c9c5f06c3ef96e1256c229b02c13bf3"
server_key_iv: "0bd21cb69f8948ca59e53207fa044ce9"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.723418 4924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance:
uuid: "704e7c429fa9416bb3f93981bd498be8"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "8c9c5f06c3ef96e1256c229b02c13bf3"
server_key_iv: "0bd21cb69f8948ca59e53207fa044ce9"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.726914 4924 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:44:46.729251 4938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.730376 4924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:46.730505 4924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal
uuid: "704e7c429fa9416bb3f93981bd498be8"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "8c9c5f06c3ef96e1256c229b02c13bf3"
server_key_iv: "0bd21cb69f8948ca59e53207fa044ce9"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.730618 4924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:46.753793 4924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:46.754441 4924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:46.754635 4924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:46.755209 4924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:46.756214 4924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:46.756286 4924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.756369 4924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:46.756403 4924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.765293 4924 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.130:45873
I20260923 14:44:46.765331 5051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.130:45873 every 8 connection(s)
I20260923 14:44:46.766191 4924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/data/info.pb
I20260923 14:44:46.772637 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 4924
I20260923 14:44:46.772794 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal/instance
I20260923 14:44:46.773128 17426 external_mini_cluster.cc:1428] Setting key a6b6752ce9c5bccb0f4608b128eb11d9
I20260923 14:44:46.775295 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.4.131:0
--local_ip_for_outbound_sockets=127.17.4.131
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36303
--builtin_ntp_servers=127.17.4.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 14:44:46.776037 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.768057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.130:46423 (local address 127.17.4.190:36303)
0923 14:44:46.768244 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.768249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.769333 (+ 1084us) server_negotiation.cc:407] Connection header received
0923 14:44:46.770683 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.770685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.770737 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.770816 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:46.771704 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.772335 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.773994 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.774213 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.774325 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.775521 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:46.775525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:46.775530 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:46.775547 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:46.775566 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:46.775574 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:46.775611 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.775817 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.775880 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 14:44:46.776892 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.768480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36303 (local address 127.17.4.130:46423)
0923 14:44:46.769176 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.769218 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.770481 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.770985 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.770991 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.771079 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:46.771566 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.771593 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.772477 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.772481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.773821 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.773831 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.774376 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.774380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.774547 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.775214 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:46.775215 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:46.775254 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:46.775315 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:46.775663 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:46.775671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:46.775674 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.775826 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.776141 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":105,"threads_started":1}
I20260923 14:44:46.778100 5052 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36303
I20260923 14:44:46.778349 5052 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:46.778862 5052 heartbeater.cc:511] Master 127.17.4.190:36303 requested a full tablet report, sending...
I20260923 14:44:46.779978 4733 ts_manager.cc:194] Registered new tserver with Master: 704e7c429fa9416bb3f93981bd498be8 (127.17.4.130:45873)
I20260923 14:44:46.780541 4733 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.130:46423
W20260923 14:44:46.885318 5055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:46.885583 5055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:46.885653 5055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:46.889494 5055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:46.889603 5055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:46.889683 5055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.4.131
I20260923 14:44:46.894677 5055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.4.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.4.131
--webserver_port=0
--tserver_master_addrs=127.17.4.190:36303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.4.131
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:46.895655 5055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:46.897023 5055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:46.906384 5061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:46.906435 5063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:46.906428 5060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:46.906642 5055 server_base.cc:1034] running on GCE node
I20260923 14:44:46.907186 5055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:46.907836 5055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:46.909029 5055 hybrid_clock.cc:648] HybridClock initialized: now 1790174686908987 us; error 62 us; skew 500 ppm
I20260923 14:44:46.918028 5055 webserver.cc:460] Webserver started at http://127.17.4.131:46859/ using document root <none> and password file <none>
I20260923 14:44:46.918622 5055 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:46.918715 5055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:46.918946 5055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:46.921048 5055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data/instance:
uuid: "07ddaf9146154f8299b878275a3102c1"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "f7ecb48f8345fdbb999cd360eef4c214"
server_key_iv: "f20947c2f9f64870db0697e72cf45e7c"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.921607 5055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance:
uuid: "07ddaf9146154f8299b878275a3102c1"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "f7ecb48f8345fdbb999cd360eef4c214"
server_key_iv: "f20947c2f9f64870db0697e72cf45e7c"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.925325 5055 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:46.928004 5069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.929154 5055 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:46.929281 5055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal
uuid: "07ddaf9146154f8299b878275a3102c1"
format_stamp: "Formatted at 2026-09-23 14:44:46 on dist-test-slave-54kg"
server_key: "f7ecb48f8345fdbb999cd360eef4c214"
server_key_iv: "f20947c2f9f64870db0697e72cf45e7c"
server_key_version: "encryptionkey@0"
I20260923 14:44:46.929396 5055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:46.949327 5055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:46.949955 5055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:46.950161 5055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:46.950771 5055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 14:44:46.951817 5055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 14:44:46.951881 5055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.951944 5055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 14:44:46.951996 5055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:46.960445 5055 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.131:39263
I20260923 14:44:46.960472 5182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.131:39263 every 8 connection(s)
I20260923 14:44:46.961290 5055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/data/info.pb
I20260923 14:44:46.961779 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5055
I20260923 14:44:46.961889 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal/instance
I20260923 14:44:46.962198 17426 external_mini_cluster.cc:1428] Setting key ddc69ea5a96fd791b3b6f94ac4dee83e
I20260923 14:44:46.970314 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.963089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.131:41919 (local address 127.17.4.190:36303)
0923 14:44:46.963223 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.963228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.964448 (+ 1220us) server_negotiation.cc:407] Connection header received
0923 14:44:46.965829 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.965832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.965885 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.965969 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:46.966826 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.967361 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.968562 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.968783 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.968889 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.969849 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:46.969853 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:46.969856 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:46.969875 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:46.969893 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:46.969901 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:46.969976 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.970123 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.970180 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:46.971074 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.963561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:36303 (local address 127.17.4.131:41919)
0923 14:44:46.964288 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.964341 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.965635 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.966153 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.966159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.966236 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:44:46.966688 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.966700 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.967490 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.967493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.968435 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.968444 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.968923 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.968926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.969084 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.969616 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 14:44:46.969617 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:44:46.969653 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 14:44:46.969710 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:44:46.969976 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:44:46.969987 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:44:46.969995 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 14:44:46.970122 (+ 127us) client_negotiation.cc:240] Negotiation successful
0923 14:44:46.970370 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":146,"threads_started":1}
I20260923 14:44:46.972229 5183 heartbeater.cc:347] Connected to a master server at 127.17.4.190:36303
I20260923 14:44:46.972453 5183 heartbeater.cc:464] Registering TS with master...
I20260923 14:44:46.972927 5183 heartbeater.cc:511] Master 127.17.4.190:36303 requested a full tablet report, sending...
I20260923 14:44:46.973898 4733 ts_manager.cc:194] Registered new tserver with Master: 07ddaf9146154f8299b878275a3102c1 (127.17.4.131:39263)
I20260923 14:44:46.974396 4733 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.4.131:41919
I20260923 14:44:46.976204 17426 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 14:44:46.981695 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.977996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.17.4.190:36303)
0923 14:44:46.978127 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.978132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.978345 (+ 213us) server_negotiation.cc:407] Connection header received
0923 14:44:46.978432 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.978434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.978469 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.978543 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:46.978784 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.979261 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.980104 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.980303 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.980376 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:46.981164 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:46.981167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:46.981169 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:46.981179 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:46.981195 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:46.981203 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:46.981263 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:46.981438 (+ 175us) server_negotiation.cc:299] Negotiation successful
0923 14:44:46.981533 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 14:44:46.984516 4733 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 14:44:46.987428 4733 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 14:44:47.000984 5195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.995203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:45873 (local address 127.0.0.1:36286)
0923 14:44:46.995741 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.995809 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.995922 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.996886 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.996892 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.996913 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.997039 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.997045 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.998366 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.998372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:46.999585 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.999594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.000518 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.000521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.000637 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.000676 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 14:44:47.000774 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 14:44:47.000878 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":88,"threads_started":1}
I20260923 14:44:47.001586 5199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.996345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47276 (local address 127.17.4.129:41275)
0923 14:44:46.996763 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.996774 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.996798 (+ 24us) server_negotiation.cc:407] Connection header received
0923 14:44:46.996874 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.996879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.997044 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.997245 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.997504 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.998781 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.000194 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.000947 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.001049 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.001205 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:47.001310 (+ 105us) server_negotiation.cc:299] Negotiation successful
0923 14:44:47.001402 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":110,"threads_started":1}
I20260923 14:44:47.001600 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.995368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36286 (local address 127.17.4.130:45873)
0923 14:44:46.996249 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.996261 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.996288 (+ 27us) server_negotiation.cc:407] Connection header received
0923 14:44:46.996363 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.996368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.996565 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.996716 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.997194 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.998255 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.999706 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.000393 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.000500 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.000674 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:47.001342 (+ 668us) server_negotiation.cc:299] Negotiation successful
0923 14:44:47.001436 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":126,"threads_started":1}
I20260923 14:44:47.001470 5197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.995914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:41275 (local address 127.0.0.1:47276)
0923 14:44:46.996654 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.996668 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.996757 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.997233 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.997236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.997255 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.997357 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.997367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.998923 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.998926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.000060 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:47.000072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.001075 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.001078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.001182 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.001204 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 14:44:47.001283 (+ 79us) client_negotiation.cc:240] Negotiation successful
0923 14:44:47.001349 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":77,"thread_start_us":104,"threads_started":1}
I20260923 14:44:47.002110 5198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.996292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47040 (local address 127.17.4.131:39263)
0923 14:44:46.997014 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:46.997022 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:46.997039 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:44:46.997118 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:46.997125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:46.997300 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:46.997455 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:46.997693 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.998835 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.000764 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.001509 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.001622 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.001813 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:47.001858 (+ 45us) server_negotiation.cc:299] Negotiation successful
0923 14:44:47.001934 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":93,"threads_started":1}
I20260923 14:44:47.002549 5194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:46.995384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:39263 (local address 127.0.0.1:47040)
0923 14:44:46.995800 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:46.995816 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:46.995927 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:46.997452 (+ 1525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:46.997455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:46.997473 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:46.997575 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:46.997588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:46.998943 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:46.998946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.000659 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:47.000667 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.001632 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.001636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.001738 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.001767 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 14:44:47.001837 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 14:44:47.002415 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":1,"spinlock_wait_cycles":2304,"thread_start_us":120,"threads_started":1}
I20260923 14:44:47.004552 4855 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc2ece78a0d4888a787007c9ef300f8 (DEFAULT_TABLE table=test-table [id=544c73220ac544a2a7e8ab613023b98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:47.004626 4986 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc2ece78a0d4888a787007c9ef300f8 (DEFAULT_TABLE table=test-table [id=544c73220ac544a2a7e8ab613023b98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:47.005046 5117 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc2ece78a0d4888a787007c9ef300f8 (DEFAULT_TABLE table=test-table [id=544c73220ac544a2a7e8ab613023b98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 14:44:47.005542 4855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc2ece78a0d4888a787007c9ef300f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:47.005620 4986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc2ece78a0d4888a787007c9ef300f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:47.005903 5117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc2ece78a0d4888a787007c9ef300f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:47.011528 5200 tablet_bootstrap.cc:492] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: Bootstrap starting.
I20260923 14:44:47.013599 5201 tablet_bootstrap.cc:492] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Bootstrap starting.
I20260923 14:44:47.013823 5200 tablet_bootstrap.cc:654] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:47.014531 5200 log.cc:824] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:47.015420 5201 tablet_bootstrap.cc:654] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:47.016139 5202 tablet_bootstrap.cc:492] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Bootstrap starting.
I20260923 14:44:47.016275 5201 log.cc:824] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:47.016448 5200 tablet_bootstrap.cc:492] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: No bootstrap required, opened a new log
I20260923 14:44:47.016671 5200 ts_tablet_manager.cc:1397] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260923 14:44:47.018499 5202 tablet_bootstrap.cc:654] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:47.018616 5201 tablet_bootstrap.cc:492] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: No bootstrap required, opened a new log
I20260923 14:44:47.018847 5201 ts_tablet_manager.cc:1397] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 14:44:47.019325 5202 log.cc:824] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:47.020449 5200 raft_consensus.cc:348] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.020679 5200 raft_consensus.cc:374] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:47.020748 5200 raft_consensus.cc:729] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 064361e5d1a34acb84f26bd44f6b6b83, State: Initialized, Role: FOLLOWER
I20260923 14:44:47.021216 5202 tablet_bootstrap.cc:492] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: No bootstrap required, opened a new log
I20260923 14:44:47.021188 5200 consensus_queue.cc:260] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.021379 5202 ts_tablet_manager.cc:1397] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 14:44:47.021968 5200 ts_tablet_manager.cc:1428] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260923 14:44:47.022327 4921 heartbeater.cc:503] Master 127.17.4.190:36303 was elected leader, sending a full tablet report...
I20260923 14:44:47.022960 5201 raft_consensus.cc:348] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.023291 5201 raft_consensus.cc:374] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:47.023396 5201 raft_consensus.cc:729] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07ddaf9146154f8299b878275a3102c1, State: Initialized, Role: FOLLOWER
I20260923 14:44:47.023887 5201 consensus_queue.cc:260] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.024554 5183 heartbeater.cc:503] Master 127.17.4.190:36303 was elected leader, sending a full tablet report...
I20260923 14:44:47.024832 5201 ts_tablet_manager.cc:1428] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 14:44:47.026432 5202 raft_consensus.cc:348] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.026669 5202 raft_consensus.cc:374] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:47.026729 5202 raft_consensus.cc:729] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 704e7c429fa9416bb3f93981bd498be8, State: Initialized, Role: FOLLOWER
I20260923 14:44:47.027148 5202 consensus_queue.cc:260] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.027830 5052 heartbeater.cc:503] Master 127.17.4.190:36303 was elected leader, sending a full tablet report...
I20260923 14:44:47.027979 5202 ts_tablet_manager.cc:1428] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260923 14:44:47.081620 4922 tablet.cc:2369] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:47.177654 5206 raft_consensus.cc:482] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 14:44:47.177938 5206 raft_consensus.cc:504] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.179101 5206 leader_election.cc:288] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 704e7c429fa9416bb3f93981bd498be8 (127.17.4.130:45873), 07ddaf9146154f8299b878275a3102c1 (127.17.4.131:39263)
I20260923 14:44:47.184530 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:47.179449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:55537 (local address 127.17.4.130:45873)
0923 14:44:47.179699 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:47.179702 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:47.179718 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:44:47.179939 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:47.179942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:47.179997 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:47.180090 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:47.180528 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.181326 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.183171 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.183821 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.183950 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.184002 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:47.184314 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 14:44:47.184389 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260923 14:44:47.184530 5198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:47.179444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.4.129:53297 (local address 127.17.4.131:39263)
0923 14:44:47.179578 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:47.179583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:47.179833 (+ 250us) server_negotiation.cc:407] Connection header received
0923 14:44:47.179939 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:47.179942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:47.179997 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:47.180084 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 14:44:47.180528 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.181318 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.183171 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.183821 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.183950 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.184002 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:47.184314 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 14:44:47.184389 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:44:47.184607 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:47.179344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.130:45873 (local address 127.17.4.129:55537)
0923 14:44:47.179647 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:47.179662 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:47.179801 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:47.180142 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:47.180145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:47.180186 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:47.180407 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:47.180414 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.181442 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.181445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.183027 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:47.183034 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.183951 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.183955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.184093 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.184197 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 14:44:47.184279 (+ 82us) client_negotiation.cc:240] Negotiation successful
0923 14:44:47.184406 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":277,"spinlock_wait_cycles":29568,"thread_start_us":93,"threads_started":1}
I20260923 14:44:47.184614 5210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:47.179346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.131:39263 (local address 127.17.4.129:53297)
0923 14:44:47.179733 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:47.179744 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:44:47.179851 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:44:47.180142 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:44:47.180145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:44:47.180187 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 14:44:47.180413 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:47.180419 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.181442 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.181445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.183021 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:44:47.183034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.183951 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.183955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:44:47.184152 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.184199 (+ 47us) client_negotiation.cc:769] Sending connection context
0923 14:44:47.184279 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 14:44:47.184406 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":350,"spinlock_wait_cycles":7936,"thread_start_us":58,"threads_started":1}
I20260923 14:44:47.185312 5006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc2ece78a0d4888a787007c9ef300f8" candidate_uuid: "064361e5d1a34acb84f26bd44f6b6b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "704e7c429fa9416bb3f93981bd498be8" is_pre_election: true
I20260923 14:44:47.185379 5137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc2ece78a0d4888a787007c9ef300f8" candidate_uuid: "064361e5d1a34acb84f26bd44f6b6b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07ddaf9146154f8299b878275a3102c1" is_pre_election: true
I20260923 14:44:47.185637 5006 raft_consensus.cc:2454] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 064361e5d1a34acb84f26bd44f6b6b83 in term 0.
I20260923 14:44:47.185663 5137 raft_consensus.cc:2454] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 064361e5d1a34acb84f26bd44f6b6b83 in term 0.
I20260923 14:44:47.186177 4811 leader_election.cc:302] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 064361e5d1a34acb84f26bd44f6b6b83, 07ddaf9146154f8299b878275a3102c1, 704e7c429fa9416bb3f93981bd498be8; no voters:
I20260923 14:44:47.186470 5206 raft_consensus.cc:2781] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 14:44:47.186569 5206 raft_consensus.cc:482] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 14:44:47.186636 5206 raft_consensus.cc:3037] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:47.187810 5206 raft_consensus.cc:504] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.188170 5206 leader_election.cc:288] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [CANDIDATE]: Term 1 election: Requested vote from peers 704e7c429fa9416bb3f93981bd498be8 (127.17.4.130:45873), 07ddaf9146154f8299b878275a3102c1 (127.17.4.131:39263)
I20260923 14:44:47.188567 5006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc2ece78a0d4888a787007c9ef300f8" candidate_uuid: "064361e5d1a34acb84f26bd44f6b6b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "704e7c429fa9416bb3f93981bd498be8"
I20260923 14:44:47.188567 5137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc2ece78a0d4888a787007c9ef300f8" candidate_uuid: "064361e5d1a34acb84f26bd44f6b6b83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07ddaf9146154f8299b878275a3102c1"
I20260923 14:44:47.188696 5006 raft_consensus.cc:3037] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:47.188696 5137 raft_consensus.cc:3037] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:47.189982 5006 raft_consensus.cc:2454] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 064361e5d1a34acb84f26bd44f6b6b83 in term 1.
I20260923 14:44:47.189982 5137 raft_consensus.cc:2454] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 064361e5d1a34acb84f26bd44f6b6b83 in term 1.
I20260923 14:44:47.190318 4808 leader_election.cc:302] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 064361e5d1a34acb84f26bd44f6b6b83, 07ddaf9146154f8299b878275a3102c1, 704e7c429fa9416bb3f93981bd498be8; no voters:
I20260923 14:44:47.190526 5206 raft_consensus.cc:2781] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:47.190748 5206 raft_consensus.cc:686] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [term 1 LEADER]: Becoming Leader. State: Replica: 064361e5d1a34acb84f26bd44f6b6b83, State: Running, Role: LEADER
I20260923 14:44:47.191063 5206 consensus_queue.cc:237] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } }
I20260923 14:44:47.194077 4733 catalog_manager.cc:5495] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 064361e5d1a34acb84f26bd44f6b6b83 (127.17.4.129). New cstate: current_term: 1 leader_uuid: "064361e5d1a34acb84f26bd44f6b6b83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "064361e5d1a34acb84f26bd44f6b6b83" member_type: VOTER last_known_addr { host: "127.17.4.129" port: 41275 } health_report { overall_health: HEALTHY } } }
W20260923 14:44:47.212327 5184 tablet.cc:2369] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:44:47.240873 5199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:47.237572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47290 (local address 127.17.4.129:41275)
0923 14:44:47.237712 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:47.237716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:47.237730 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:44:47.237812 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:47.237814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:47.237872 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:47.237965 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:44:47.238200 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.238692 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.239559 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:47.239797 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:47.239887 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:47.240153 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:44:47.240565 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:44:47.240659 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:47.240713 (+ 54us) server_negotiation.cc:299] Negotiation successful
0923 14:44:47.240761 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 14:44:47.246964 5006 raft_consensus.cc:1261] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 1 FOLLOWER]: Refusing update from remote peer 064361e5d1a34acb84f26bd44f6b6b83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:47.246964 5137 raft_consensus.cc:1261] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 1 FOLLOWER]: Refusing update from remote peer 064361e5d1a34acb84f26bd44f6b6b83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:44:47.247807 5206 consensus_queue.cc:1035] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07ddaf9146154f8299b878275a3102c1" member_type: VOTER last_known_addr { host: "127.17.4.131" port: 39263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:47.248014 5211 consensus_queue.cc:1035] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "704e7c429fa9416bb3f93981bd498be8" member_type: VOTER last_known_addr { host: "127.17.4.130" port: 45873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:44:47.265502 4733 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:47.265688 4733 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 14:44:47.268049 4733 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eac68e8cea5e45fd94a2f1690df2f772: Sending DeleteTablet for 3 replicas of tablet 0cc2ece78a0d4888a787007c9ef300f8
I20260923 14:44:47.268859 4855 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc2ece78a0d4888a787007c9ef300f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:47 UTC) from {username='slave'} at 127.0.0.1:47276
I20260923 14:44:47.268859 5117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc2ece78a0d4888a787007c9ef300f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:47 UTC) from {username='slave'} at 127.0.0.1:47040
I20260923 14:44:47.269342 4986 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc2ece78a0d4888a787007c9ef300f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 14:44:47 UTC) from {username='slave'} at 127.0.0.1:36286
I20260923 14:44:47.269665 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4793
I20260923 14:44:47.269837 5225 tablet_replica.cc:330] T 0cc2ece78a0d4888a787007c9ef300f8 P 064361e5d1a34acb84f26bd44f6b6b83: stopping tablet replica
I20260923 14:44:47.269837 5226 tablet_replica.cc:330] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: stopping tablet replica
I20260923 14:44:47.270114 5226 raft_consensus.cc:2229] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:47.270493 5226 raft_consensus.cc:2258] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:47.270524 5224 tablet_replica.cc:330] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: stopping tablet replica
I20260923 14:44:47.270787 5224 raft_consensus.cc:2229] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 14:44:47.270993 5224 raft_consensus.cc:2258] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 14:44:47.272430 5224 ts_tablet_manager.cc:1905] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:47.272459 5226 ts_tablet_manager.cc:1905] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 14:44:47.275122 5226 ts_tablet_manager.cc:1918] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:47.275122 5224 ts_tablet_manager.cc:1918] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 14:44:47.275224 5226 log.cc:1196] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-1/wal/wals/0cc2ece78a0d4888a787007c9ef300f8
I20260923 14:44:47.275224 5224 log.cc:1196] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Deleting WAL directory at /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790174436877568-17426-0/minicluster-data/ts-2/wal/wals/0cc2ece78a0d4888a787007c9ef300f8
I20260923 14:44:47.275544 5226 ts_tablet_manager.cc:1939] T 0cc2ece78a0d4888a787007c9ef300f8 P 704e7c429fa9416bb3f93981bd498be8: Deleting consensus metadata
I20260923 14:44:47.275544 5224 ts_tablet_manager.cc:1939] T 0cc2ece78a0d4888a787007c9ef300f8 P 07ddaf9146154f8299b878275a3102c1: Deleting consensus metadata
I20260923 14:44:47.276818 4717 catalog_manager.cc:4841] TS 07ddaf9146154f8299b878275a3102c1 (127.17.4.131:39263): tablet 0cc2ece78a0d4888a787007c9ef300f8 (table test-table [id=544c73220ac544a2a7e8ab613023b98e]) successfully deleted
I20260923 14:44:47.276818 4720 catalog_manager.cc:4841] TS 704e7c429fa9416bb3f93981bd498be8 (127.17.4.130:45873): tablet 0cc2ece78a0d4888a787007c9ef300f8 (table test-table [id=544c73220ac544a2a7e8ab613023b98e]) successfully deleted
I20260923 14:44:47.277163 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4924
W20260923 14:44:47.277215 4720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.4.129:41275 (error 108)
I20260923 14:44:47.278867 5195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:47.278528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.129:41275 (local address 127.0.0.1:47292)
0923 14:44:47.278679 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0923 14:44:47.278761 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.129:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260923 14:44:47.279017 4720 catalog_manager.cc:4584] TS 064361e5d1a34acb84f26bd44f6b6b83 (127.17.4.129:41275): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0cc2ece78a0d4888a787007c9ef300f8: Network error: Client connection negotiation failed: client connection to 127.17.4.129:41275: connect: Connection refused (error 111)
I20260923 14:44:47.283087 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5055
I20260923 14:44:47.289265 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 4702
2026-09-23T14:44:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1170 ms)
[----------] 6 tests from EncryptionPolicyTest (10514 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:47 dist-test-slave-54kg krb5kdc[5230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:47 dist-test-slave-54kg krb5kdc[5230](info): set up 2 sockets
Sep 23 14:44:47 dist-test-slave-54kg krb5kdc[5230](info): commencing operation
krb5kdc: starting...
W20260923 14:44:48.336917 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:48 dist-test-slave-54kg krb5kdc[5230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:48.463430 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41969
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:48.570888 5243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:48.571184 5243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:48.571259 5243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:48.575207 5243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:48.575295 5243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:48.575333 5243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:48.575390 5243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:48.575425 5243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:48.580564 5243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41969
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:48.581609 5243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:48.582599 5243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:48.591254 5251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:48.591277 5248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:48.591411 5243 server_base.cc:1034] running on GCE node
W20260923 14:44:48.591279 5249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:48.592213 5243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:48.593343 5243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:48.594529 5243 hybrid_clock.cc:648] HybridClock initialized: now 1790174688594516 us; error 37 us; skew 500 ppm
Sep 23 14:44:48 dist-test-slave-54kg krb5kdc[5230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174688, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:48.597313 5243 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:48.598161 5243 webserver.cc:460] Webserver started at http://127.0.0.1:35687/ using document root <none> and password file <none>
I20260923 14:44:48.598722 5243 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:48.598783 5243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:48.598941 5243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:48.600939 5243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "ffaed6586bcd483aa0c39afbdd333e37"
format_stamp: "Formatted at 2026-09-23 14:44:48 on dist-test-slave-54kg"
server_key: "ca242f2323959d8f3c9bfafd31d33bcb"
server_key_iv: "d8107c1ee2d8f39506318d802fd6a549"
server_key_version: "encryptionkey@0"
I20260923 14:44:48.601442 5243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "ffaed6586bcd483aa0c39afbdd333e37"
format_stamp: "Formatted at 2026-09-23 14:44:48 on dist-test-slave-54kg"
server_key: "ca242f2323959d8f3c9bfafd31d33bcb"
server_key_iv: "d8107c1ee2d8f39506318d802fd6a549"
server_key_version: "encryptionkey@0"
I20260923 14:44:48.604977 5243 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:44:48.607175 5258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:48.608417 5243 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:48.608547 5243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "ffaed6586bcd483aa0c39afbdd333e37"
format_stamp: "Formatted at 2026-09-23 14:44:48 on dist-test-slave-54kg"
server_key: "ca242f2323959d8f3c9bfafd31d33bcb"
server_key_iv: "d8107c1ee2d8f39506318d802fd6a549"
server_key_version: "encryptionkey@0"
I20260923 14:44:48.608664 5243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:48.638501 5243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:48.641536 5243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:48.641742 5243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:48.649120 5243 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41969
I20260923 14:44:48.649148 5310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41969 every 8 connection(s)
I20260923 14:44:48.650058 5243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:48.652768 5311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:48.658471 5311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37: Bootstrap starting.
I20260923 14:44:48.659397 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5243
I20260923 14:44:48.659500 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:48.659864 17426 external_mini_cluster.cc:1428] Setting key e00e050909bfb7a516b1d0d71bf911e1
I20260923 14:44:48.661351 5311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:48.662233 5311 log.cc:824] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:48.664393 5311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37: No bootstrap required, opened a new log
I20260923 14:44:48.668403 5311 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffaed6586bcd483aa0c39afbdd333e37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41969 } }
I20260923 14:44:48.668669 5311 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:48.668735 5311 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffaed6586bcd483aa0c39afbdd333e37, State: Initialized, Role: FOLLOWER
Sep 23 14:44:48 dist-test-slave-54kg krb5kdc[5230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 14:44:48.669231 5311 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffaed6586bcd483aa0c39afbdd333e37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41969 } }
I20260923 14:44:48.669400 5311 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:48.669480 5311 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:48.669590 5311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:48.670508 5311 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffaed6586bcd483aa0c39afbdd333e37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41969 } }
I20260923 14:44:48.670848 5311 leader_election.cc:302] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffaed6586bcd483aa0c39afbdd333e37; no voters:
I20260923 14:44:48.671159 5311 leader_election.cc:288] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:48.671262 5316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:48.671475 5316 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [term 1 LEADER]: Becoming Leader. State: Replica: ffaed6586bcd483aa0c39afbdd333e37, State: Running, Role: LEADER
I20260923 14:44:48.671813 5316 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffaed6586bcd483aa0c39afbdd333e37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41969 } }
I20260923 14:44:48.672502 5311 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:48.673041 5318 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffaed6586bcd483aa0c39afbdd333e37. Latest consensus state: current_term: 1 leader_uuid: "ffaed6586bcd483aa0c39afbdd333e37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffaed6586bcd483aa0c39afbdd333e37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41969 } } }
I20260923 14:44:48.673177 5318 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:48.673597 5321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:48.673869 5317 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffaed6586bcd483aa0c39afbdd333e37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffaed6586bcd483aa0c39afbdd333e37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41969 } } }
I20260923 14:44:48.673969 5317 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:48.676194 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:48.661028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59787 (local address 127.0.0.1:41969)
0923 14:44:48.661547 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:48.661570 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:48.661616 (+ 46us) server_negotiation.cc:407] Connection header received
0923 14:44:48.662451 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:48.662475 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:48.662857 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:48.663221 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:48.663938 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:48.665357 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:48.666180 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:48.666910 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:48.667094 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:48.669909 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:48.669914 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:48.669926 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:48.669954 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:48.672164 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:48.672800 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:48.672807 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:48.672815 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:48.672958 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:48.673376 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:48.673380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:48.673382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:48.673958 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:48.674191 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:48.674976 (+ 785us) server_negotiation.cc:299] Negotiation successful
0923 14:44:48.675199 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":129,"threads_started":1}
I20260923 14:44:48.677048 5321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:48.679366 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:48.684643 5321 catalog_manager.cc:1347] Generated new cluster ID: 5cb2739af56047b59b1758441fb9425a
I20260923 14:44:48.684700 5321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:48.690097 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:48.681496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53257 (local address 127.0.0.1:41969)
0923 14:44:48.681622 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:48.681627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:48.681847 (+ 220us) server_negotiation.cc:407] Connection header received
0923 14:44:48.681969 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:48.681972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:48.682016 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:48.682102 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:48.682906 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:48.683534 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:48.684442 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:48.684799 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:48.685288 (+ 489us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:48.686517 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:48.686520 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:48.686523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:48.686544 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:48.688092 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:48.688605 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:48.688608 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:48.688609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:48.688678 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:48.689006 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:48.689008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:48.689010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:48.689201 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:48.689783 (+ 582us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:48.689869 (+ 86us) server_negotiation.cc:299] Negotiation successful
0923 14:44:48.689949 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:44:48.706172 5321 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:48.707006 5321 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:48.715288 5321 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffaed6586bcd483aa0c39afbdd333e37: Generated new TSK 0
I20260923 14:44:48.715930 5321 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:48.724009 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5243
W20260923 14:44:48.729610 5228 connection.cc:535] client connection to 127.0.0.1:41969 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41969): Connection reset by peer (error 104)
2026-09-23T14:44:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1430 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:48 dist-test-slave-54kg krb5kdc[5342](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:48 dist-test-slave-54kg krb5kdc[5342](info): set up 2 sockets
Sep 23 14:44:48 dist-test-slave-54kg krb5kdc[5342](info): commencing operation
krb5kdc: starting...
W20260923 14:44:49.753036 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:49 dist-test-slave-54kg krb5kdc[5342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:49.874920 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38539
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:49.981861 5355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:49.982110 5355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:49.982151 5355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:49.986127 5355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:49.986186 5355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:49.986205 5355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:49.986222 5355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:49.986286 5355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:49.991395 5355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38539
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:49.992502 5355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:49.993513 5355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:50.002143 5361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:50.002147 5360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:50.002187 5355 server_base.cc:1034] running on GCE node
W20260923 14:44:50.002143 5363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:50.003036 5355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:50.004235 5355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:50.005414 5355 hybrid_clock.cc:648] HybridClock initialized: now 1790174690005382 us; error 43 us; skew 500 ppm
Sep 23 14:44:50 dist-test-slave-54kg krb5kdc[5342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174689, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:50.008273 5355 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:50.009171 5355 webserver.cc:460] Webserver started at http://127.0.0.1:38929/ using document root <none> and password file <none>
I20260923 14:44:50.009745 5355 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:50.009806 5355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:50.010044 5355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:50.012162 5355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "d5a949a6b5394236bf5bf113e8f66d42"
format_stamp: "Formatted at 2026-09-23 14:44:50 on dist-test-slave-54kg"
server_key: "185d48a027f2716dd0047fa8db3156c8"
server_key_iv: "0a8190276da4f765aceeb86e4311a637"
server_key_version: "encryptionkey@0"
I20260923 14:44:50.012722 5355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "d5a949a6b5394236bf5bf113e8f66d42"
format_stamp: "Formatted at 2026-09-23 14:44:50 on dist-test-slave-54kg"
server_key: "185d48a027f2716dd0047fa8db3156c8"
server_key_iv: "0a8190276da4f765aceeb86e4311a637"
server_key_version: "encryptionkey@0"
I20260923 14:44:50.016443 5355 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:44:50.018757 5370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:50.020040 5355 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:44:50.020174 5355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "d5a949a6b5394236bf5bf113e8f66d42"
format_stamp: "Formatted at 2026-09-23 14:44:50 on dist-test-slave-54kg"
server_key: "185d48a027f2716dd0047fa8db3156c8"
server_key_iv: "0a8190276da4f765aceeb86e4311a637"
server_key_version: "encryptionkey@0"
I20260923 14:44:50.020284 5355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:50.033469 5355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:50.036763 5355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:50.036965 5355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:50.043854 5355 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38539
I20260923 14:44:50.043879 5422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38539 every 8 connection(s)
I20260923 14:44:50.044780 5355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:50.047353 5423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:50.050750 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5355
I20260923 14:44:50.050900 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:50.051206 17426 external_mini_cluster.cc:1428] Setting key 3277628a0dd85b47fa2e5582f11b7ce2
I20260923 14:44:50.053395 5423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42: Bootstrap starting.
I20260923 14:44:50.055478 5423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:50.056264 5423 log.cc:824] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:50.058010 5423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42: No bootstrap required, opened a new log
I20260923 14:44:50.060134 5426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:50.052625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57827 (local address 127.0.0.1:38539)
0923 14:44:50.053049 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:50.053063 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:50.053118 (+ 55us) server_negotiation.cc:407] Connection header received
0923 14:44:50.053803 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:50.053821 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:50.054150 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:50.054465 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:50.054870 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:50.055954 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:50.056957 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:50.057434 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:50.057597 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:50.058501 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:50.058506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:50.058518 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:50.058884 (+ 366us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:50.058933 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:50.058954 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:50.059097 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:50.059261 (+ 164us) server_negotiation.cc:299] Negotiation successful
0923 14:44:50.059389 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":133,"threads_started":1}
I20260923 14:44:50.061772 5423 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a949a6b5394236bf5bf113e8f66d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38539 } }
I20260923 14:44:50.062076 5423 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:50.062165 5423 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5a949a6b5394236bf5bf113e8f66d42, State: Initialized, Role: FOLLOWER
I20260923 14:44:50.062678 5423 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a949a6b5394236bf5bf113e8f66d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38539 } }
I20260923 14:44:50.062835 5423 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:50.062947 5423 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:50.063058 5423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:50.063129 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:50.063971 5423 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a949a6b5394236bf5bf113e8f66d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38539 } }
I20260923 14:44:50.064283 5423 leader_election.cc:302] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5a949a6b5394236bf5bf113e8f66d42; no voters:
I20260923 14:44:50.064641 5423 leader_election.cc:288] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:50.064705 5432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:50.064931 5432 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [term 1 LEADER]: Becoming Leader. State: Replica: d5a949a6b5394236bf5bf113e8f66d42, State: Running, Role: LEADER
I20260923 14:44:50.065230 5432 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a949a6b5394236bf5bf113e8f66d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38539 } }
I20260923 14:44:50.065893 5423 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:50.066447 5432 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5a949a6b5394236bf5bf113e8f66d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a949a6b5394236bf5bf113e8f66d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38539 } } }
I20260923 14:44:50.066617 5432 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:50.066867 5432 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5a949a6b5394236bf5bf113e8f66d42. Latest consensus state: current_term: 1 leader_uuid: "d5a949a6b5394236bf5bf113e8f66d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a949a6b5394236bf5bf113e8f66d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38539 } } }
I20260923 14:44:50.067008 5432 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:50.069700 5426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:50.065450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38419 (local address 127.0.0.1:38539)
0923 14:44:50.065563 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:50.065569 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:50.065583 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:44:50.065617 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:50.065620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:50.065664 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:50.065745 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:50.066007 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:50.066683 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:50.067830 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:50.068144 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:50.068244 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:50.069286 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:50.069290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:50.069292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:50.069304 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:50.069330 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:50.069342 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:50.069432 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:50.069533 (+ 101us) server_negotiation.cc:299] Negotiation successful
0923 14:44:50.069570 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260923 14:44:50.071003 5449 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:44:50.071067 5449 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:44:50.071146 5440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:50.071977 5440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:50.077330 5440 catalog_manager.cc:1347] Generated new cluster ID: 590b2177ce364cf5b84e2429a745d5e4
I20260923 14:44:50.077401 5440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:50.092742 5440 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:50.093873 5440 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:50.099747 5440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5a949a6b5394236bf5bf113e8f66d42: Generated new TSK 0
I20260923 14:44:50.100417 5440 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:50.104368 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5355
W20260923 14:44:50.109712 5340 connection.cc:535] client connection to 127.0.0.1:38539 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38539): Connection reset by peer (error 104)
2026-09-23T14:44:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:50 dist-test-slave-54kg krb5kdc[5454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:50 dist-test-slave-54kg krb5kdc[5454](info): set up 2 sockets
Sep 23 14:44:50 dist-test-slave-54kg krb5kdc[5454](info): commencing operation
krb5kdc: starting...
W20260923 14:44:51.137240 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:51 dist-test-slave-54kg krb5kdc[5454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:51.263307 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34647
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:51.372470 5467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:51.372751 5467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:51.372793 5467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:51.376874 5467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:51.376941 5467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:51.376961 5467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:51.376978 5467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:51.377030 5467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:51.382349 5467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34647
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:51.383389 5467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:51.384439 5467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:51.393231 5472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:51.393345 5467 server_base.cc:1034] running on GCE node
W20260923 14:44:51.393287 5475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:51.393287 5473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:51.394064 5467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:51.395130 5467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:51.396332 5467 hybrid_clock.cc:648] HybridClock initialized: now 1790174691396324 us; error 30 us; skew 500 ppm
Sep 23 14:44:51 dist-test-slave-54kg krb5kdc[5454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174691, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:51.399204 5467 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:51.400403 5467 webserver.cc:460] Webserver started at http://127.0.0.1:44995/ using document root <none> and password file <none>
I20260923 14:44:51.400988 5467 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:51.401086 5467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:51.401320 5467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:51.403350 5467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "2762752aa922485189b476884c52e3b3"
format_stamp: "Formatted at 2026-09-23 14:44:51 on dist-test-slave-54kg"
server_key: "465fdf3032d09acc1745b1bb95880adf"
server_key_iv: "2b36f3770457bd15b62fdafdf22ebf68"
server_key_version: "encryptionkey@0"
I20260923 14:44:51.404000 5467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "2762752aa922485189b476884c52e3b3"
format_stamp: "Formatted at 2026-09-23 14:44:51 on dist-test-slave-54kg"
server_key: "465fdf3032d09acc1745b1bb95880adf"
server_key_iv: "2b36f3770457bd15b62fdafdf22ebf68"
server_key_version: "encryptionkey@0"
I20260923 14:44:51.407516 5467 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:44:51.409921 5482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:51.411190 5467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:51.411324 5467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "2762752aa922485189b476884c52e3b3"
format_stamp: "Formatted at 2026-09-23 14:44:51 on dist-test-slave-54kg"
server_key: "465fdf3032d09acc1745b1bb95880adf"
server_key_iv: "2b36f3770457bd15b62fdafdf22ebf68"
server_key_version: "encryptionkey@0"
I20260923 14:44:51.411432 5467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:51.415838 5467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:51.419026 5467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:51.419200 5467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:51.426097 5467 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34647
I20260923 14:44:51.426167 5534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34647 every 8 connection(s)
I20260923 14:44:51.426990 5467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:51.429287 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5467
I20260923 14:44:51.429445 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:51.429756 17426 external_mini_cluster.cc:1428] Setting key 6c75f51a18fab0e63d6f9b91bfa220f5
I20260923 14:44:51.429806 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:51.435299 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:51.431114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54421 (local address 127.0.0.1:34647)
0923 14:44:51.431523 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:51.431561 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:51.431602 (+ 41us) server_negotiation.cc:407] Connection header received
0923 14:44:51.432497 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:51.432520 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:51.432863 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:51.433217 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:51.433931 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:51.433936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:51.433951 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:51.433962 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:51.434028 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:51.434055 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:51.434187 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:51.434249 (+ 62us) server_negotiation.cc:299] Negotiation successful
0923 14:44:51.434403 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":116,"threads_started":1}
I20260923 14:44:51.437122 5535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3: Bootstrap starting.
I20260923 14:44:51.438566 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:51.439834 5535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:51.440783 5535 log.cc:824] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:51.442567 5535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3: No bootstrap required, opened a new log
I20260923 14:44:51.442834 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:51.441033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48847 (local address 127.0.0.1:34647)
0923 14:44:51.441148 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:51.441152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:51.441426 (+ 274us) server_negotiation.cc:407] Connection header received
0923 14:44:51.441564 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:51.441566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:51.441603 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:51.441688 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:51.442399 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:51.442403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:51.442405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:51.442416 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:51.442459 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:51.442470 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:51.442556 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:51.442671 (+ 115us) server_negotiation.cc:299] Negotiation successful
0923 14:44:51.442706 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 14:44:51.445989 5535 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2762752aa922485189b476884c52e3b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260923 14:44:51.446220 5535 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:51.446300 5535 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2762752aa922485189b476884c52e3b3, State: Initialized, Role: FOLLOWER
I20260923 14:44:51.446691 5535 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2762752aa922485189b476884c52e3b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260923 14:44:51.446834 5535 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:51.446919 5535 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:51.447013 5535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:51.447949 5535 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2762752aa922485189b476884c52e3b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260923 14:44:51.448269 5535 leader_election.cc:302] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2762752aa922485189b476884c52e3b3; no voters:
I20260923 14:44:51.448565 5535 leader_election.cc:288] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:51.448680 5545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:51.448917 5545 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [term 1 LEADER]: Becoming Leader. State: Replica: 2762752aa922485189b476884c52e3b3, State: Running, Role: LEADER
I20260923 14:44:51.449256 5545 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2762752aa922485189b476884c52e3b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } }
I20260923 14:44:51.449759 5535 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:51.450873 5546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2762752aa922485189b476884c52e3b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2762752aa922485189b476884c52e3b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } } }
I20260923 14:44:51.451047 5546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:51.451393 5547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2762752aa922485189b476884c52e3b3. Latest consensus state: current_term: 1 leader_uuid: "2762752aa922485189b476884c52e3b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2762752aa922485189b476884c52e3b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34647 } } }
I20260923 14:44:51.451547 5547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:51.451570 5554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:51.454267 5554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:51.459363 5554 catalog_manager.cc:1347] Generated new cluster ID: de61b5a80c4e41c6af7f7a201aac98f7
I20260923 14:44:51.459441 5554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:51.469125 5554 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:51.469412 5554 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:51.478240 5554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2762752aa922485189b476884c52e3b3: Generated new TSK 0
I20260923 14:44:51.478950 5554 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:51.483948 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5467
2026-09-23T14:44:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1379 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:51 dist-test-slave-54kg krb5kdc[5566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:51 dist-test-slave-54kg krb5kdc[5566](info): set up 2 sockets
Sep 23 14:44:51 dist-test-slave-54kg krb5kdc[5566](info): commencing operation
krb5kdc: starting...
W20260923 14:44:52.621137 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:52 dist-test-slave-54kg krb5kdc[5566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:52.739135 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44673
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:52.848387 5579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:52.848682 5579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:52.848750 5579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:52.852629 5579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:52.852715 5579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:52.852753 5579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:52.852787 5579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:52.852821 5579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:52.858064 5579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:52.859133 5579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:52.860544 5579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:52.868489 5584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:52.868590 5579 server_base.cc:1034] running on GCE node
W20260923 14:44:52.868566 5585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:52.868819 5587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:52.869357 5579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:52.870368 5579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:52.871553 5579 hybrid_clock.cc:648] HybridClock initialized: now 1790174692871539 us; error 33 us; skew 500 ppm
Sep 23 14:44:52 dist-test-slave-54kg krb5kdc[5566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174692, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:52.879153 5579 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:52.880146 5579 webserver.cc:460] Webserver started at http://127.0.0.1:34407/ using document root <none> and password file <none>
I20260923 14:44:52.880714 5579 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:52.880805 5579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:52.881037 5579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:52.883072 5579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "b272856d79164177a3fba339871e1d0e"
format_stamp: "Formatted at 2026-09-23 14:44:52 on dist-test-slave-54kg"
server_key: "e3a913b8f6e99a386747940a59ffd9e8"
server_key_iv: "8d02fab541eaca23d22da61fec03cdbe"
server_key_version: "encryptionkey@0"
I20260923 14:44:52.883623 5579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "b272856d79164177a3fba339871e1d0e"
format_stamp: "Formatted at 2026-09-23 14:44:52 on dist-test-slave-54kg"
server_key: "e3a913b8f6e99a386747940a59ffd9e8"
server_key_iv: "8d02fab541eaca23d22da61fec03cdbe"
server_key_version: "encryptionkey@0"
I20260923 14:44:52.887219 5579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:44:52.889508 5594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:52.890664 5579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:52.890789 5579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "b272856d79164177a3fba339871e1d0e"
format_stamp: "Formatted at 2026-09-23 14:44:52 on dist-test-slave-54kg"
server_key: "e3a913b8f6e99a386747940a59ffd9e8"
server_key_iv: "8d02fab541eaca23d22da61fec03cdbe"
server_key_version: "encryptionkey@0"
I20260923 14:44:52.890887 5579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:52.924228 5579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:52.927462 5579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:52.927667 5579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:52.935050 5579 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44673
I20260923 14:44:52.935066 5646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44673 every 8 connection(s)
I20260923 14:44:52.936064 5579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:52.938666 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:52.943833 5647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e: Bootstrap starting.
I20260923 14:44:52.945796 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5579
I20260923 14:44:52.945930 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:52.946239 17426 external_mini_cluster.cc:1428] Setting key c9833992dcc3b0124d6dbe2073d5f3c2
I20260923 14:44:52.946360 5647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:52.947090 5647 log.cc:824] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:52.949079 5647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e: No bootstrap required, opened a new log
I20260923 14:44:52.952504 5647 raft_consensus.cc:348] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b272856d79164177a3fba339871e1d0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44673 } }
I20260923 14:44:52.952848 5647 raft_consensus.cc:374] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:52.952955 5647 raft_consensus.cc:729] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b272856d79164177a3fba339871e1d0e, State: Initialized, Role: FOLLOWER
I20260923 14:44:52.953531 5647 consensus_queue.cc:260] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b272856d79164177a3fba339871e1d0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44673 } }
I20260923 14:44:52.953715 5647 raft_consensus.cc:388] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:52.953792 5647 raft_consensus.cc:482] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:52.953909 5647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 0 FOLLOWER]: Advancing to term 1
Sep 23 14:44:52 dist-test-slave-54kg krb5kdc[5566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 14:44:52.954922 5647 raft_consensus.cc:504] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b272856d79164177a3fba339871e1d0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44673 } }
I20260923 14:44:52.955260 5647 leader_election.cc:302] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b272856d79164177a3fba339871e1d0e; no voters:
I20260923 14:44:52.955565 5647 leader_election.cc:288] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:52.955668 5652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:52.955925 5652 raft_consensus.cc:686] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [term 1 LEADER]: Becoming Leader. State: Replica: b272856d79164177a3fba339871e1d0e, State: Running, Role: LEADER
I20260923 14:44:52.956350 5652 consensus_queue.cc:237] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b272856d79164177a3fba339871e1d0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44673 } }
I20260923 14:44:52.956957 5647 sys_catalog.cc:564] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:52.958133 5653 sys_catalog.cc:455] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b272856d79164177a3fba339871e1d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b272856d79164177a3fba339871e1d0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44673 } } }
I20260923 14:44:52.958288 5653 sys_catalog.cc:458] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:52.958552 5654 sys_catalog.cc:455] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b272856d79164177a3fba339871e1d0e. Latest consensus state: current_term: 1 leader_uuid: "b272856d79164177a3fba339871e1d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b272856d79164177a3fba339871e1d0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44673 } } }
I20260923 14:44:52.958657 5654 sys_catalog.cc:458] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:52.958688 5661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:52.961318 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:52.947334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49271 (local address 127.0.0.1:44673)
0923 14:44:52.947742 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:52.947787 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:52.947833 (+ 46us) server_negotiation.cc:407] Connection header received
0923 14:44:52.948483 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:52.948498 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:52.948839 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:52.949177 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:52.949988 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:52.950936 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:52.951808 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:52.952391 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:52.952577 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:52.955546 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:52.955555 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:52.955573 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:52.955605 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:52.958016 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:52.958586 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:52.958592 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:52.958598 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:52.958750 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:52.959051 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:52.959054 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:52.959056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:52.959542 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:52.959731 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:52.960104 (+ 373us) server_negotiation.cc:299] Negotiation successful
0923 14:44:52.960406 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
I20260923 14:44:52.961994 5661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:52.964293 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:52.967379 5661 catalog_manager.cc:1347] Generated new cluster ID: 3eb008aa2d034a07828f021a544956f0
I20260923 14:44:52.967437 5661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:52.974033 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:52.966495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50929 (local address 127.0.0.1:44673)
0923 14:44:52.966595 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:52.966600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:52.966841 (+ 241us) server_negotiation.cc:407] Connection header received
0923 14:44:52.966950 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:52.966953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:52.966998 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:52.967076 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:52.967966 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:52.968539 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:52.969323 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:52.969573 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:52.969701 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:52.970967 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:52.970970 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:52.970973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:52.970996 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:52.972430 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:52.972861 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:52.972865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:52.972867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:52.972941 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:52.973234 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:52.973238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:52.973240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:52.973403 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:52.973538 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:52.973768 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 14:44:52.973884 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 14:44:52.997099 5661 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:52.998227 5661 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:53.010088 5661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b272856d79164177a3fba339871e1d0e: Generated new TSK 0
I20260923 14:44:53.010828 5661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:53.016304 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5579
2026-09-23T14:44:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1532 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:53 dist-test-slave-54kg krb5kdc[5678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:53 dist-test-slave-54kg krb5kdc[5678](info): set up 2 sockets
Sep 23 14:44:53 dist-test-slave-54kg krb5kdc[5678](info): commencing operation
krb5kdc: starting...
W20260923 14:44:54.061203 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:54 dist-test-slave-54kg krb5kdc[5678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:54.185184 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40571
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:54.294720 5691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:54.295045 5691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:54.295130 5691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:54.299216 5691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:54.299316 5691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:54.299356 5691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:54.299414 5691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:54.299453 5691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:54.304899 5691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:54.306041 5691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:54.307101 5691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:54.315510 5697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:54.315564 5696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:54.315814 5699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:54.315793 5691 server_base.cc:1034] running on GCE node
I20260923 14:44:54.316458 5691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:54.317545 5691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:54.318748 5691 hybrid_clock.cc:648] HybridClock initialized: now 1790174694318734 us; error 36 us; skew 500 ppm
Sep 23 14:44:54 dist-test-slave-54kg krb5kdc[5678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174694, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:54.321556 5691 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:54.322448 5691 webserver.cc:460] Webserver started at http://127.0.0.1:33249/ using document root <none> and password file <none>
I20260923 14:44:54.322981 5691 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:54.323076 5691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:54.323297 5691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:54.325378 5691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5"
format_stamp: "Formatted at 2026-09-23 14:44:54 on dist-test-slave-54kg"
server_key: "745016af3b5a2b9313d587fc42c4d31b"
server_key_iv: "232b8b082eec9108eed08e9d5978a500"
server_key_version: "encryptionkey@0"
I20260923 14:44:54.325959 5691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5"
format_stamp: "Formatted at 2026-09-23 14:44:54 on dist-test-slave-54kg"
server_key: "745016af3b5a2b9313d587fc42c4d31b"
server_key_iv: "232b8b082eec9108eed08e9d5978a500"
server_key_version: "encryptionkey@0"
I20260923 14:44:54.329640 5691 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:44:54.332041 5706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:54.333249 5691 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:44:54.333384 5691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5"
format_stamp: "Formatted at 2026-09-23 14:44:54 on dist-test-slave-54kg"
server_key: "745016af3b5a2b9313d587fc42c4d31b"
server_key_iv: "232b8b082eec9108eed08e9d5978a500"
server_key_version: "encryptionkey@0"
I20260923 14:44:54.333493 5691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:54.350430 5691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:54.353636 5691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:54.353850 5691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:54.361379 5691 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40571
I20260923 14:44:54.361394 5758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40571 every 8 connection(s)
I20260923 14:44:54.362345 5691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:54.365307 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:54.370895 5759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5: Bootstrap starting.
I20260923 14:44:54.371490 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5691
I20260923 14:44:54.371663 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:54.371989 17426 external_mini_cluster.cc:1428] Setting key 5e7a3c85117001b939ffadd668eef931
I20260923 14:44:54.373708 5759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:54.374439 5759 log.cc:824] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:54.376617 5759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5: No bootstrap required, opened a new log
I20260923 14:44:54.380987 5759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40571 } }
I20260923 14:44:54.381232 5759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:54.381214 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:54.373318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52877 (local address 127.0.0.1:40571)
0923 14:44:54.373730 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:54.373745 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:54.373780 (+ 35us) server_negotiation.cc:407] Connection header received
0923 14:44:54.374467 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:54.374483 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:54.374913 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:54.375301 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:54.375685 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:54.376755 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:54.377956 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:54.378432 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:54.378549 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:54.379422 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:54.379427 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:54.379439 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:54.379912 (+ 473us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:54.379967 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:54.379990 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:54.380088 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:54.380226 (+ 138us) server_negotiation.cc:299] Negotiation successful
0923 14:44:54.380451 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":125,"threads_started":1}
I20260923 14:44:54.381331 5759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac8fd8dc7a24b2c86a81b03acf99ca5, State: Initialized, Role: FOLLOWER
I20260923 14:44:54.381846 5759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40571 } }
I20260923 14:44:54.382006 5759 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:54.382068 5759 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:54.382160 5759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:54.383137 5759 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40571 } }
I20260923 14:44:54.383510 5759 leader_election.cc:302] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ac8fd8dc7a24b2c86a81b03acf99ca5; no voters:
I20260923 14:44:54.383922 5759 leader_election.cc:288] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:54.384018 5764 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:54.384241 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:54.384236 5764 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 7ac8fd8dc7a24b2c86a81b03acf99ca5, State: Running, Role: LEADER
I20260923 14:44:54.384536 5764 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40571 } }
I20260923 14:44:54.385313 5759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:54.385982 5765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40571 } } }
I20260923 14:44:54.386122 5765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:54.386446 5766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ac8fd8dc7a24b2c86a81b03acf99ca5. Latest consensus state: current_term: 1 leader_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ac8fd8dc7a24b2c86a81b03acf99ca5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40571 } } }
I20260923 14:44:54.386530 5766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:54.387132 5775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:54.390094 5775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:54.392109 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:54.386790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50233 (local address 127.0.0.1:40571)
0923 14:44:54.386915 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:54.386919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:54.387680 (+ 761us) server_negotiation.cc:407] Connection header received
0923 14:44:54.387887 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:54.387890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:54.387938 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:54.388037 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:54.388305 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:54.389060 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:54.390229 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:54.390582 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:54.390672 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:54.391605 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:54.391609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:54.391611 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:54.391627 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:54.391657 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:54.391670 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:54.391749 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:54.391912 (+ 163us) server_negotiation.cc:299] Negotiation successful
0923 14:44:54.391967 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 14:44:54.395679 5775 catalog_manager.cc:1347] Generated new cluster ID: b7989354e25240168b3101006ab97af6
I20260923 14:44:54.395746 5775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:54.408311 5775 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:54.409284 5775 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:54.417640 5775 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ac8fd8dc7a24b2c86a81b03acf99ca5: Generated new TSK 0
I20260923 14:44:54.418330 5775 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:54.425838 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5691
2026-09-23T14:44:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:54 dist-test-slave-54kg krb5kdc[5790](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:54 dist-test-slave-54kg krb5kdc[5790](info): set up 2 sockets
Sep 23 14:44:54 dist-test-slave-54kg krb5kdc[5790](info): commencing operation
krb5kdc: starting...
W20260923 14:44:55.457096 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:55 dist-test-slave-54kg krb5kdc[5790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:55.584303 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:55.702629 5803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:55.702925 5803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:55.702968 5803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:55.706976 5803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:55.707052 5803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:55.707073 5803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:55.707090 5803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:55.707106 5803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:55.712350 5803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:55.713378 5803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:55.714349 5803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:55.723006 5811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:55.723060 5808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:55.723047 5803 server_base.cc:1034] running on GCE node
W20260923 14:44:55.723165 5809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:55.723897 5803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:55.724989 5803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:55.726171 5803 hybrid_clock.cc:648] HybridClock initialized: now 1790174695726137 us; error 49 us; skew 500 ppm
Sep 23 14:44:55 dist-test-slave-54kg krb5kdc[5790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:55.728977 5803 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:55.729890 5803 webserver.cc:460] Webserver started at http://127.0.0.1:43849/ using document root <none> and password file <none>
I20260923 14:44:55.730417 5803 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:55.730477 5803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:55.730641 5803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:55.732739 5803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "23117bfae50e499590f860be012ffa80"
format_stamp: "Formatted at 2026-09-23 14:44:55 on dist-test-slave-54kg"
server_key: "fa8fb096fdfccc25338ff1c2d8edf551"
server_key_iv: "fbaf954af4c99c95816d173da9236fad"
server_key_version: "encryptionkey@0"
I20260923 14:44:55.733265 5803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "23117bfae50e499590f860be012ffa80"
format_stamp: "Formatted at 2026-09-23 14:44:55 on dist-test-slave-54kg"
server_key: "fa8fb096fdfccc25338ff1c2d8edf551"
server_key_iv: "fbaf954af4c99c95816d173da9236fad"
server_key_version: "encryptionkey@0"
I20260923 14:44:55.736969 5803 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260923 14:44:55.739403 5818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:55.740799 5803 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:55.740940 5803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "23117bfae50e499590f860be012ffa80"
format_stamp: "Formatted at 2026-09-23 14:44:55 on dist-test-slave-54kg"
server_key: "fa8fb096fdfccc25338ff1c2d8edf551"
server_key_iv: "fbaf954af4c99c95816d173da9236fad"
server_key_version: "encryptionkey@0"
I20260923 14:44:55.741067 5803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:55.745842 5803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:55.749181 5803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:55.749384 5803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:55.757050 5803 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39937
I20260923 14:44:55.757061 5870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39937 every 8 connection(s)
I20260923 14:44:55.758041 5803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:55.761085 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5803
I20260923 14:44:55.761235 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:55.761250 5871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:55.761577 17426 external_mini_cluster.cc:1428] Setting key d0a59abcd7d6e60f19a5dbe8f2c7df7b
I20260923 14:44:55.767397 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:55.763142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37097 (local address 127.0.0.1:39937)
0923 14:44:55.763634 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:55.763650 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:55.763685 (+ 35us) server_negotiation.cc:407] Connection header received
0923 14:44:55.764664 (+ 979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:55.764684 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:55.765007 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:55.765364 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:55.766215 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:55.766219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:55.766231 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:55.766242 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:55.766296 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:55.766315 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:55.766472 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:55.766543 (+ 71us) server_negotiation.cc:299] Negotiation successful
0923 14:44:55.766703 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":145,"threads_started":1}
I20260923 14:44:55.768427 5871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80: Bootstrap starting.
I20260923 14:44:55.770320 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:55.770943 5871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:55.771739 5871 log.cc:824] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:55.773824 5871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80: No bootstrap required, opened a new log
I20260923 14:44:55.775682 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:55.772506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33967 (local address 127.0.0.1:39937)
0923 14:44:55.772631 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:55.772635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:55.774178 (+ 1543us) server_negotiation.cc:407] Connection header received
0923 14:44:55.774312 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:55.774315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:55.774345 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:55.774415 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:55.775175 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:55.775178 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:55.775181 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:55.775191 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:55.775217 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:55.775227 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:55.775308 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:55.775467 (+ 159us) server_negotiation.cc:299] Negotiation successful
0923 14:44:55.775538 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:44:55.778474 5871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23117bfae50e499590f860be012ffa80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 14:44:55.778801 5871 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:55.778865 5871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23117bfae50e499590f860be012ffa80, State: Initialized, Role: FOLLOWER
I20260923 14:44:55.779318 5871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23117bfae50e499590f860be012ffa80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 14:44:55.779474 5871 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:55.779542 5871 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:55.779642 5871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:55.780730 5871 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23117bfae50e499590f860be012ffa80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 14:44:55.781106 5871 leader_election.cc:302] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23117bfae50e499590f860be012ffa80; no voters:
I20260923 14:44:55.781483 5871 leader_election.cc:288] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:55.781605 5881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:55.781883 5881 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [term 1 LEADER]: Becoming Leader. State: Replica: 23117bfae50e499590f860be012ffa80, State: Running, Role: LEADER
I20260923 14:44:55.782227 5881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23117bfae50e499590f860be012ffa80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 14:44:55.782886 5871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:55.784022 5882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23117bfae50e499590f860be012ffa80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23117bfae50e499590f860be012ffa80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } } }
I20260923 14:44:55.784170 5882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:55.784030 5883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23117bfae50e499590f860be012ffa80. Latest consensus state: current_term: 1 leader_uuid: "23117bfae50e499590f860be012ffa80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23117bfae50e499590f860be012ffa80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } } }
I20260923 14:44:55.784231 5883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:55.784581 5890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:55.788255 5890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:55.794566 5890 catalog_manager.cc:1347] Generated new cluster ID: a43a854e218c4624b6004b400e0271e6
I20260923 14:44:55.794668 5890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:55.803149 5890 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:55.803503 5890 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:55.810987 5890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23117bfae50e499590f860be012ffa80: Generated new TSK 0
I20260923 14:44:55.811686 5890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:55.823729 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5803
2026-09-23T14:44:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1396 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:55 dist-test-slave-54kg krb5kdc[5903](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:55 dist-test-slave-54kg krb5kdc[5903](info): set up 2 sockets
Sep 23 14:44:55 dist-test-slave-54kg krb5kdc[5903](info): commencing operation
krb5kdc: starting...
W20260923 14:44:56.857227 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:56 dist-test-slave-54kg krb5kdc[5903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:56.982968 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:57.097139 5916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:57.097432 5916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:57.097525 5916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:57.101933 5916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:57.102012 5916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:57.102034 5916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:57.102072 5916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:57.102104 5916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:57.107756 5916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:57.108960 5916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:57.110033 5916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:57.119098 5922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:57.119104 5924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:57.119104 5921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:57.119159 5916 server_base.cc:1034] running on GCE node
I20260923 14:44:57.120011 5916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:57.121202 5916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:57.122402 5916 hybrid_clock.cc:648] HybridClock initialized: now 1790174697122371 us; error 52 us; skew 500 ppm
Sep 23 14:44:57 dist-test-slave-54kg krb5kdc[5903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174697, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:57.125339 5916 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:57.126368 5916 webserver.cc:460] Webserver started at http://127.0.0.1:39707/ using document root <none> and password file <none>
I20260923 14:44:57.126996 5916 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:57.127099 5916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:57.127348 5916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:57.129580 5916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "c3df982f3fbe4754aa87814a95f03385"
format_stamp: "Formatted at 2026-09-23 14:44:57 on dist-test-slave-54kg"
server_key: "9b24167130a851aed07a2c8893d78799"
server_key_iv: "f146e60fbed33ef1722c837b5ef16edd"
server_key_version: "encryptionkey@0"
I20260923 14:44:57.130203 5916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "c3df982f3fbe4754aa87814a95f03385"
format_stamp: "Formatted at 2026-09-23 14:44:57 on dist-test-slave-54kg"
server_key: "9b24167130a851aed07a2c8893d78799"
server_key_iv: "f146e60fbed33ef1722c837b5ef16edd"
server_key_version: "encryptionkey@0"
I20260923 14:44:57.134222 5916 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260923 14:44:57.136951 5931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:57.138258 5916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:57.138413 5916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "c3df982f3fbe4754aa87814a95f03385"
format_stamp: "Formatted at 2026-09-23 14:44:57 on dist-test-slave-54kg"
server_key: "9b24167130a851aed07a2c8893d78799"
server_key_iv: "f146e60fbed33ef1722c837b5ef16edd"
server_key_version: "encryptionkey@0"
I20260923 14:44:57.138542 5916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:57.165567 5916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:57.168851 5916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:57.169092 5916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:57.176579 5916 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38845
I20260923 14:44:57.176600 5983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38845 every 8 connection(s)
I20260923 14:44:57.177600 5916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:57.179862 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 5916
I20260923 14:44:57.180015 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:57.180392 17426 external_mini_cluster.cc:1428] Setting key b10e3c5b1a827b84fa5006a2b9fdadb3
I20260923 14:44:57.180891 5984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:57.187155 5984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385: Bootstrap starting.
Sep 23 14:44:57 dist-test-slave-54kg krb5kdc[5903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 14:44:57.189838 5984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:57.190634 5984 log.cc:824] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:57.193123 5984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385: No bootstrap required, opened a new log
I20260923 14:44:57.195319 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:57.181899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:60427 (local address 127.0.0.1:38845)
0923 14:44:57.182373 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:57.182389 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:57.182426 (+ 37us) server_negotiation.cc:407] Connection header received
0923 14:44:57.183103 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:57.183120 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:57.183461 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:57.183833 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:57.184689 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:57.185719 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:57.186622 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:57.187110 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:57.187279 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:57.190214 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:57.190220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:57.190235 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:57.190264 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:57.192241 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:57.192860 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:57.192865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:57.192870 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:57.192981 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:57.193331 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:57.193334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:57.193335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:57.193738 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:57.193897 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:57.194239 (+ 342us) server_negotiation.cc:299] Negotiation successful
0923 14:44:57.194490 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":157,"threads_started":1}
I20260923 14:44:57.197320 5984 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3df982f3fbe4754aa87814a95f03385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38845 } }
I20260923 14:44:57.197597 5984 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:57.197646 5984 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3df982f3fbe4754aa87814a95f03385, State: Initialized, Role: FOLLOWER
I20260923 14:44:57.198112 5984 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3df982f3fbe4754aa87814a95f03385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38845 } }
I20260923 14:44:57.198269 5984 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:57.198341 5984 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:57.198446 5984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:57.198607 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:57.199483 5984 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3df982f3fbe4754aa87814a95f03385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38845 } }
I20260923 14:44:57.199882 5984 leader_election.cc:302] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3df982f3fbe4754aa87814a95f03385; no voters:
I20260923 14:44:57.200219 5984 leader_election.cc:288] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:57.200291 5993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:57.200502 5993 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [term 1 LEADER]: Becoming Leader. State: Replica: c3df982f3fbe4754aa87814a95f03385, State: Running, Role: LEADER
I20260923 14:44:57.200827 5993 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3df982f3fbe4754aa87814a95f03385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38845 } }
I20260923 14:44:57.201516 5984 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:57.202483 5994 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3df982f3fbe4754aa87814a95f03385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3df982f3fbe4754aa87814a95f03385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38845 } } }
I20260923 14:44:57.202611 5994 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:57.202839 5994 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3df982f3fbe4754aa87814a95f03385. Latest consensus state: current_term: 1 leader_uuid: "c3df982f3fbe4754aa87814a95f03385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3df982f3fbe4754aa87814a95f03385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38845 } } }
I20260923 14:44:57.202909 5994 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385 [sys.catalog]: This master's current role is: LEADER
W20260923 14:44:57.207044 6010 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:44:57.207145 6010 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:44:57.207268 6003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:57.208101 6003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:57.210171 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:57.200731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:59491 (local address 127.0.0.1:38845)
0923 14:44:57.200840 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:57.200845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:57.201196 (+ 351us) server_negotiation.cc:407] Connection header received
0923 14:44:57.201333 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:57.201336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:57.201384 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:57.201472 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:57.202356 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:57.203152 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:57.204356 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:57.204584 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:57.204669 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:57.206362 (+ 1693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:57.206366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:57.206368 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:44:57.206396 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:57.208168 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:57.208725 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:57.208729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:57.208731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:57.208818 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:44:57.209192 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:44:57.209195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:44:57.209197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:44:57.209417 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:57.209568 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:57.209884 (+ 316us) server_negotiation.cc:299] Negotiation successful
0923 14:44:57.209989 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260923 14:44:57.213964 6003 catalog_manager.cc:1347] Generated new cluster ID: 8c76f7700e2a4463a70857a80b37fc14
I20260923 14:44:57.214046 6003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:57.222455 6003 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:57.223417 6003 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:57.228796 6003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3df982f3fbe4754aa87814a95f03385: Generated new TSK 0
I20260923 14:44:57.229513 6003 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:57.235266 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 5916
W20260923 14:44:57.240631 5901 connection.cc:535] client connection to 127.0.0.1:38845 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38845): Connection reset by peer (error 104)
2026-09-23T14:44:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:57 dist-test-slave-54kg krb5kdc[6015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:57 dist-test-slave-54kg krb5kdc[6015](info): set up 2 sockets
Sep 23 14:44:57 dist-test-slave-54kg krb5kdc[6015](info): commencing operation
krb5kdc: starting...
W20260923 14:44:58.277076 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:58 dist-test-slave-54kg krb5kdc[6015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:58.402575 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42197
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:58.509791 6028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:58.510072 6028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:58.510159 6028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:58.514088 6028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:58.514170 6028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:58.514209 6028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:58.514272 6028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:58.514310 6028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:58.519320 6028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:58.520372 6028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:58.521337 6028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:58.529369 6033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:58.529377 6036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:58.529377 6034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:58.529592 6028 server_base.cc:1034] running on GCE node
I20260923 14:44:58.530158 6028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:58.531160 6028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:58.532343 6028 hybrid_clock.cc:648] HybridClock initialized: now 1790174698532337 us; error 28 us; skew 500 ppm
Sep 23 14:44:58 dist-test-slave-54kg krb5kdc[6015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174698, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:58.551083 6028 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:58.552145 6028 webserver.cc:460] Webserver started at http://127.0.0.1:46179/ using document root <none> and password file <none>
I20260923 14:44:58.552726 6028 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:58.552817 6028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:58.553056 6028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:58.555168 6028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "728c45a949bc4a7aaf7c47c61d792ab9"
format_stamp: "Formatted at 2026-09-23 14:44:58 on dist-test-slave-54kg"
server_key: "2b51a9d4e2fa457af31fff177023eb66"
server_key_iv: "549b42998e9285136f0e6d00a1b9fd21"
server_key_version: "encryptionkey@0"
I20260923 14:44:58.555747 6028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "728c45a949bc4a7aaf7c47c61d792ab9"
format_stamp: "Formatted at 2026-09-23 14:44:58 on dist-test-slave-54kg"
server_key: "2b51a9d4e2fa457af31fff177023eb66"
server_key_iv: "549b42998e9285136f0e6d00a1b9fd21"
server_key_version: "encryptionkey@0"
I20260923 14:44:58.559444 6028 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:44:58.561878 6043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:58.563135 6028 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:44:58.563282 6028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "728c45a949bc4a7aaf7c47c61d792ab9"
format_stamp: "Formatted at 2026-09-23 14:44:58 on dist-test-slave-54kg"
server_key: "2b51a9d4e2fa457af31fff177023eb66"
server_key_iv: "549b42998e9285136f0e6d00a1b9fd21"
server_key_version: "encryptionkey@0"
I20260923 14:44:58.563390 6028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:58.585029 6028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:58.588259 6028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:58.588441 6028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:58.595453 6028 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42197
I20260923 14:44:58.595474 6095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42197 every 8 connection(s)
I20260923 14:44:58.596410 6028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:58.598387 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6028
I20260923 14:44:58.598497 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:58.598791 17426 external_mini_cluster.cc:1428] Setting key 017b83fec8d06f50d935d53d5a09c14c
I20260923 14:44:58.599272 6096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:58.606279 6096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9: Bootstrap starting.
I20260923 14:44:58.608516 6099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:58.600219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:55935 (local address 127.0.0.1:42197)
0923 14:44:58.600646 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:58.600670 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:58.600711 (+ 41us) server_negotiation.cc:407] Connection header received
0923 14:44:58.601509 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:58.601549 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:58.601964 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:58.602317 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:58.602721 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:58.604175 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:58.605035 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:58.605726 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:58.605900 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:58.606802 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:58.606806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:58.606817 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:58.607208 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:58.607264 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:58.607285 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:58.607393 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:58.607650 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 14:44:58.607844 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
I20260923 14:44:58.608852 6096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:58.609661 6096 log.cc:824] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:58.611351 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:58.611595 6096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9: No bootstrap required, opened a new log
I20260923 14:44:58.616223 6096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260923 14:44:58.616493 6096 raft_consensus.cc:374] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:58.616559 6096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 728c45a949bc4a7aaf7c47c61d792ab9, State: Initialized, Role: FOLLOWER
I20260923 14:44:58.617035 6096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260923 14:44:58.617218 6096 raft_consensus.cc:388] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:58.617308 6096 raft_consensus.cc:482] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:58.617432 6096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:58.617865 6099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:58.613544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:57495 (local address 127.0.0.1:42197)
0923 14:44:58.613663 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:58.613667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:58.613863 (+ 196us) server_negotiation.cc:407] Connection header received
0923 14:44:58.613995 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:58.613997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:58.614035 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:58.614096 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:58.614422 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:58.614897 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:58.616074 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:44:58.616287 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:44:58.616363 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:44:58.617260 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:58.617263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:58.617266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:58.617279 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:58.617307 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:58.617319 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:58.617425 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:58.617682 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 14:44:58.617712 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 14:44:58.618517 6096 raft_consensus.cc:504] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260923 14:44:58.618870 6096 leader_election.cc:302] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 728c45a949bc4a7aaf7c47c61d792ab9; no voters:
I20260923 14:44:58.619123 6096 leader_election.cc:288] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:58.619248 6106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:58.619488 6106 raft_consensus.cc:686] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [term 1 LEADER]: Becoming Leader. State: Replica: 728c45a949bc4a7aaf7c47c61d792ab9, State: Running, Role: LEADER
I20260923 14:44:58.619851 6106 consensus_queue.cc:237] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260923 14:44:58.620401 6096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:58.621604 6107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } } }
I20260923 14:44:58.621724 6107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:58.622032 6108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 728c45a949bc4a7aaf7c47c61d792ab9. Latest consensus state: current_term: 1 leader_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "728c45a949bc4a7aaf7c47c61d792ab9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } } }
I20260923 14:44:58.622107 6115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:58.622141 6108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9 [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:58.625175 6115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:58.631004 6115 catalog_manager.cc:1347] Generated new cluster ID: 1007c71379fe4b02ad167ce51dab37f4
I20260923 14:44:58.631105 6115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:44:58.647305 6115 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:44:58.648427 6115 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:44:58.653630 6115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 728c45a949bc4a7aaf7c47c61d792ab9: Generated new TSK 0
I20260923 14:44:58.654325 6115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:44:58.661509 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6028
W20260923 14:44:58.666930 6013 connection.cc:535] client connection to 127.0.0.1:42197 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42197): Connection reset by peer (error 104)
2026-09-23T14:44:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:44:58 dist-test-slave-54kg krb5kdc[6127](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:44:58 dist-test-slave-54kg krb5kdc[6127](info): set up 2 sockets
Sep 23 14:44:58 dist-test-slave-54kg krb5kdc[6127](info): commencing operation
krb5kdc: starting...
W20260923 14:44:59.685050 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.003s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:44:59 dist-test-slave-54kg krb5kdc[6127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:44:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:44:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:44:59.803722 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:44:59.910830 6140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:44:59.911058 6140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:44:59.911136 6140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:44:59.915078 6140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:44:59.915129 6140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:44:59.915148 6140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:44:59.915165 6140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:44:59.915221 6140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:44:59.920181 6140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:44:59.921059 6140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:44:59.921993 6140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:44:59.929889 6146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:59.930038 6140 server_base.cc:1034] running on GCE node
W20260923 14:44:59.929900 6148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:44:59.929900 6145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:44:59.930634 6140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:44:59.931636 6140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:44:59.932818 6140 hybrid_clock.cc:648] HybridClock initialized: now 1790174699932807 us; error 22 us; skew 500 ppm
Sep 23 14:44:59 dist-test-slave-54kg krb5kdc[6127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174699, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:44:59.935339 6140 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:44:59.936239 6140 webserver.cc:460] Webserver started at http://127.0.0.1:44489/ using document root <none> and password file <none>
I20260923 14:44:59.936764 6140 fs_manager.cc:359] Metadata directory not provided
I20260923 14:44:59.936852 6140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:44:59.937074 6140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:44:59.939100 6140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "56585e49f15c401fa9676eca5e6329ee"
format_stamp: "Formatted at 2026-09-23 14:44:59 on dist-test-slave-54kg"
server_key: "b01dea99f91cb2545431a7dea6a0638b"
server_key_iv: "e1bb8a327539dccd2941a4c7c7a790d8"
server_key_version: "encryptionkey@0"
I20260923 14:44:59.939621 6140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "56585e49f15c401fa9676eca5e6329ee"
format_stamp: "Formatted at 2026-09-23 14:44:59 on dist-test-slave-54kg"
server_key: "b01dea99f91cb2545431a7dea6a0638b"
server_key_iv: "e1bb8a327539dccd2941a4c7c7a790d8"
server_key_version: "encryptionkey@0"
I20260923 14:44:59.942993 6140 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 14:44:59.945223 6155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:44:59.946292 6140 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:44:59.946424 6140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "56585e49f15c401fa9676eca5e6329ee"
format_stamp: "Formatted at 2026-09-23 14:44:59 on dist-test-slave-54kg"
server_key: "b01dea99f91cb2545431a7dea6a0638b"
server_key_iv: "e1bb8a327539dccd2941a4c7c7a790d8"
server_key_version: "encryptionkey@0"
I20260923 14:44:59.946523 6140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:44:59.950767 6140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:44:59.953439 6140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:44:59.953619 6140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:44:59.960008 6140 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41989
I20260923 14:44:59.960076 6207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41989 every 8 connection(s)
I20260923 14:44:59.960992 6140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:44:59.963625 6208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:44:59.968621 6208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee: Bootstrap starting.
I20260923 14:44:59.969249 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6140
I20260923 14:44:59.969389 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:44:59.969659 17426 external_mini_cluster.cc:1428] Setting key 9a37c0b3d336987e7e1b8df48c8a49a1
I20260923 14:44:59.971145 6208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee: Neither blocks nor log segments found. Creating new log.
I20260923 14:44:59.972033 6208 log.cc:824] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee: Log is configured to *not* fsync() on all Append() calls
I20260923 14:44:59.973920 6208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee: No bootstrap required, opened a new log
I20260923 14:44:59.974638 6211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:59.970719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:52275 (local address 127.0.0.1:41989)
0923 14:44:59.971167 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:59.971186 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:59.971226 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:44:59.972118 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:59.972140 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:59.972480 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:59.972797 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:59.973504 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:59.973510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:59.973530 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:59.973541 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:59.973588 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:59.973605 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:59.973715 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:59.973822 (+ 107us) server_negotiation.cc:299] Negotiation successful
0923 14:44:59.973965 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":102,"threads_started":1}
I20260923 14:44:59.977269 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:44:59.977687 6208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56585e49f15c401fa9676eca5e6329ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260923 14:44:59.977880 6208 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:44:59.977952 6208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56585e49f15c401fa9676eca5e6329ee, State: Initialized, Role: FOLLOWER
I20260923 14:44:59.978389 6208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56585e49f15c401fa9676eca5e6329ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260923 14:44:59.978551 6208 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:44:59.978667 6208 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:44:59.978789 6208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:44:59.979975 6208 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56585e49f15c401fa9676eca5e6329ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260923 14:44:59.980358 6208 leader_election.cc:302] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56585e49f15c401fa9676eca5e6329ee; no voters:
I20260923 14:44:59.980715 6208 leader_election.cc:288] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:44:59.980824 6218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:44:59.981031 6211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:44:59.979299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:38403 (local address 127.0.0.1:41989)
0923 14:44:59.979390 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0923 14:44:59.979394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:44:59.979558 (+ 164us) server_negotiation.cc:407] Connection header received
0923 14:44:59.979698 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:44:59.979700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:44:59.979726 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:44:59.979837 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:44:59.980555 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:44:59.980558 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:44:59.980561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:44:59.980572 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:44:59.980603 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:44:59.980613 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:44:59.980703 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 14:44:59.980872 (+ 169us) server_negotiation.cc:299] Negotiation successful
0923 14:44:59.980915 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260923 14:44:59.981078 6218 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [term 1 LEADER]: Becoming Leader. State: Replica: 56585e49f15c401fa9676eca5e6329ee, State: Running, Role: LEADER
I20260923 14:44:59.981849 6218 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56585e49f15c401fa9676eca5e6329ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } }
I20260923 14:44:59.981915 6208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:44:59.984884 6219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56585e49f15c401fa9676eca5e6329ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56585e49f15c401fa9676eca5e6329ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } } }
I20260923 14:44:59.985001 6219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [sys.catalog]: This master's current role is: LEADER
I20260923 14:44:59.985255 6220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56585e49f15c401fa9676eca5e6329ee. Latest consensus state: current_term: 1 leader_uuid: "56585e49f15c401fa9676eca5e6329ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56585e49f15c401fa9676eca5e6329ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41989 } } }
I20260923 14:44:59.985338 6220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee [sys.catalog]: This master's current role is: LEADER
W20260923 14:44:59.986971 6232 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:44:59.987063 6232 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:44:59.987155 6234 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:44:59.987913 6234 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:44:59.992847 6234 catalog_manager.cc:1347] Generated new cluster ID: 86ef9b14369d45be97c6f20a90ffccc3
I20260923 14:44:59.992906 6234 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:00.005434 6234 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:00.005731 6234 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:00.017973 6234 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56585e49f15c401fa9676eca5e6329ee: Generated new TSK 0
I20260923 14:45:00.018702 6234 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:00.025171 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6140
2026-09-23T14:45:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:00 dist-test-slave-54kg krb5kdc[6239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:00 dist-test-slave-54kg krb5kdc[6239](info): set up 2 sockets
Sep 23 14:45:00 dist-test-slave-54kg krb5kdc[6239](info): commencing operation
krb5kdc: starting...
W20260923 14:45:01.037118 17426 mini_kdc.cc:121] Time spent starting KDC: real 0.992s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:01 dist-test-slave-54kg krb5kdc[6239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:45:01.153092 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35123
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:01.260620 6252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:01.260914 6252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:01.260985 6252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:01.264955 6252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:01.265040 6252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:01.265082 6252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:01.265138 6252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:01.265177 6252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:01.270318 6252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35123
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:01.271341 6252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:01.272395 6252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:01.280747 6258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:01.280905 6252 server_base.cc:1034] running on GCE node
W20260923 14:45:01.280823 6260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:01.280747 6257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:01.281561 6252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:01.282606 6252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:01.283797 6252 hybrid_clock.cc:648] HybridClock initialized: now 1790174701283732 us; error 40 us; skew 500 ppm
Sep 23 14:45:01 dist-test-slave-54kg krb5kdc[6239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174701, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:01.286477 6252 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:45:01.287339 6252 webserver.cc:460] Webserver started at http://127.0.0.1:45337/ using document root <none> and password file <none>
I20260923 14:45:01.287977 6252 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:01.288054 6252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:01.288285 6252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:01.290239 6252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "ab4e5b95e6c749c79e7265b00909fdd2"
format_stamp: "Formatted at 2026-09-23 14:45:01 on dist-test-slave-54kg"
server_key: "29462ddfe6dfa80ed4b304225a989de9"
server_key_iv: "d7e4fac96399fa8ac436e7d299753a9e"
server_key_version: "encryptionkey@0"
I20260923 14:45:01.290781 6252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "ab4e5b95e6c749c79e7265b00909fdd2"
format_stamp: "Formatted at 2026-09-23 14:45:01 on dist-test-slave-54kg"
server_key: "29462ddfe6dfa80ed4b304225a989de9"
server_key_iv: "d7e4fac96399fa8ac436e7d299753a9e"
server_key_version: "encryptionkey@0"
I20260923 14:45:01.294306 6252 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260923 14:45:01.296628 6267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:01.297814 6252 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:45:01.297952 6252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "ab4e5b95e6c749c79e7265b00909fdd2"
format_stamp: "Formatted at 2026-09-23 14:45:01 on dist-test-slave-54kg"
server_key: "29462ddfe6dfa80ed4b304225a989de9"
server_key_iv: "d7e4fac96399fa8ac436e7d299753a9e"
server_key_version: "encryptionkey@0"
I20260923 14:45:01.298075 6252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:01.323138 6252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:01.326131 6252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:01.326380 6252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:01.333211 6252 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35123
I20260923 14:45:01.333237 6319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35123 every 8 connection(s)
I20260923 14:45:01.334151 6252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:01.336836 6320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:01.338732 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6252
I20260923 14:45:01.338877 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:01.339185 17426 external_mini_cluster.cc:1428] Setting key 036c07f5ccf58224fe992e0870b2b7c3
I20260923 14:45:01.343061 6320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2: Bootstrap starting.
I20260923 14:45:01.345302 6320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:01.346056 6320 log.cc:824] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2: Log is configured to *not* fsync() on all Append() calls
Sep 23 14:45:01 dist-test-slave-54kg krb5kdc[6239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 14:45:01.348242 6320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2: No bootstrap required, opened a new log
I20260923 14:45:01.351648 6320 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260923 14:45:01.351938 6320 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:01.352020 6320 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab4e5b95e6c749c79e7265b00909fdd2, State: Initialized, Role: FOLLOWER
I20260923 14:45:01.352543 6320 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260923 14:45:01.352715 6320 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:01.352843 6320 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:01.352977 6320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:01.353850 6323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:01.340587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:43895 (local address 127.0.0.1:35123)
0923 14:45:01.340984 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:01.341005 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:01.341038 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:45:01.341637 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:01.341652 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:01.341966 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:01.342293 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:01.343064 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:01.344097 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:01.345019 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:01.345530 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:01.345695 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:01.348580 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:01.348584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:01.348596 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:01.348622 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:01.350788 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:01.351352 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:01.351357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:01.351362 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:01.351461 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:01.351848 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:01.351850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:01.351851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:01.352327 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:01.352489 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:01.352888 (+ 399us) server_negotiation.cc:299] Negotiation successful
0923 14:45:01.353152 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":114,"threads_started":1}
I20260923 14:45:01.353883 6320 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260923 14:45:01.354277 6320 leader_election.cc:302] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab4e5b95e6c749c79e7265b00909fdd2; no voters:
I20260923 14:45:01.354606 6320 leader_election.cc:288] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:01.354745 6325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:01.354952 6325 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [term 1 LEADER]: Becoming Leader. State: Replica: ab4e5b95e6c749c79e7265b00909fdd2, State: Running, Role: LEADER
I20260923 14:45:01.355310 6325 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260923 14:45:01.355880 6320 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:01.357031 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:01.357059 6326 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } } }
I20260923 14:45:01.357162 6326 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:01.357524 6334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:01.358450 6327 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab4e5b95e6c749c79e7265b00909fdd2. Latest consensus state: current_term: 1 leader_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4e5b95e6c749c79e7265b00909fdd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } } }
I20260923 14:45:01.358590 6327 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:01.361227 6334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:01.367724 6334 catalog_manager.cc:1347] Generated new cluster ID: df477767693b4c2db333a3a8e463e06d
I20260923 14:45:01.367871 6334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:01.368582 6323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:01.359277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:37695 (local address 127.0.0.1:35123)
0923 14:45:01.359393 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:01.359397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:01.359516 (+ 119us) server_negotiation.cc:407] Connection header received
0923 14:45:01.359638 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:01.359641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:01.359684 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:01.359784 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:01.360529 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:01.361293 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:01.362598 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:01.362947 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:01.363068 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:01.364787 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:01.364790 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:01.364793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:01.364817 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:01.366547 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:01.367108 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:01.367112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:01.367117 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:01.367203 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:01.367592 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:01.367596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:01.367597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:01.367850 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:01.368003 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:01.368326 (+ 323us) server_negotiation.cc:299] Negotiation successful
0923 14:45:01.368427 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:45:01.380226 6334 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:01.381456 6334 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:01.393649 6334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab4e5b95e6c749c79e7265b00909fdd2: Generated new TSK 0
I20260923 14:45:01.394515 6334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:01.400665 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6252
W20260923 14:45:01.406040 6237 connection.cc:535] client connection to 127.0.0.1:35123 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35123): Connection reset by peer (error 104)
2026-09-23T14:45:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1375 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:01 dist-test-slave-54kg krb5kdc[6351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:01 dist-test-slave-54kg krb5kdc[6351](info): set up 2 sockets
Sep 23 14:45:01 dist-test-slave-54kg krb5kdc[6351](info): commencing operation
krb5kdc: starting...
W20260923 14:45:02.440971 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:02 dist-test-slave-54kg krb5kdc[6351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:45:02.562414 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:02.669708 6364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:02.670006 6364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:02.670082 6364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:02.674124 6364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:02.674237 6364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:02.674274 6364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:02.674332 6364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:02.674368 6364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:02.679683 6364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:02.680752 6364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:02.681748 6364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:02.690112 6369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:02.690097 6372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:02.690097 6370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:02.690220 6364 server_base.cc:1034] running on GCE node
I20260923 14:45:02.690985 6364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:02.692129 6364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:02.693312 6364 hybrid_clock.cc:648] HybridClock initialized: now 1790174702693301 us; error 25 us; skew 500 ppm
Sep 23 14:45:02 dist-test-slave-54kg krb5kdc[6351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174702, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:02.696074 6364 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:45:02.696929 6364 webserver.cc:460] Webserver started at http://127.0.0.1:40139/ using document root <none> and password file <none>
I20260923 14:45:02.697475 6364 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:02.697566 6364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:02.697822 6364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:02.699873 6364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4"
format_stamp: "Formatted at 2026-09-23 14:45:02 on dist-test-slave-54kg"
server_key: "68c7d3812ce0f1ad962d8a41000cdc2c"
server_key_iv: "4dfef6197e93e13bf68d7238c5ebc07b"
server_key_version: "encryptionkey@0"
I20260923 14:45:02.700436 6364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4"
format_stamp: "Formatted at 2026-09-23 14:45:02 on dist-test-slave-54kg"
server_key: "68c7d3812ce0f1ad962d8a41000cdc2c"
server_key_iv: "4dfef6197e93e13bf68d7238c5ebc07b"
server_key_version: "encryptionkey@0"
I20260923 14:45:02.704005 6364 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260923 14:45:02.706235 6379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:02.707376 6364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:45:02.707520 6364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4"
format_stamp: "Formatted at 2026-09-23 14:45:02 on dist-test-slave-54kg"
server_key: "68c7d3812ce0f1ad962d8a41000cdc2c"
server_key_iv: "4dfef6197e93e13bf68d7238c5ebc07b"
server_key_version: "encryptionkey@0"
I20260923 14:45:02.707638 6364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:02.721304 6364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:02.724545 6364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:02.724753 6364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:02.731863 6364 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43775
I20260923 14:45:02.731879 6431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43775 every 8 connection(s)
I20260923 14:45:02.732789 6364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:02.735594 6432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:02.738636 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6364
I20260923 14:45:02.738781 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:02.739045 17426 external_mini_cluster.cc:1428] Setting key 42edf9ab06cadb87bc07a06b2a26f606
I20260923 14:45:02.741626 6432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4: Bootstrap starting.
I20260923 14:45:02.743904 6432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:02.744626 6432 log.cc:824] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:02.746387 6432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4: No bootstrap required, opened a new log
I20260923 14:45:02.747982 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:02.740523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:43005 (local address 127.0.0.1:43775)
0923 14:45:02.740925 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:02.740940 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:02.740973 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:45:02.741558 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:02.741573 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:02.741966 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:02.742300 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:02.742710 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:02.743718 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:02.744721 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:02.745219 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:02.745385 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:02.746267 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:02.746280 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:02.746293 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:02.746711 (+ 418us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:02.746782 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:02.746805 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:02.746943 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:02.747130 (+ 187us) server_negotiation.cc:299] Negotiation successful
0923 14:45:02.747263 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":114,"threads_started":1}
I20260923 14:45:02.750485 6432 raft_consensus.cc:348] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43775 } }
I20260923 14:45:02.750759 6432 raft_consensus.cc:374] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:02.750792 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:02.750821 6432 raft_consensus.cc:729] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e56f6d5dd6874ec6b0b9b67cceb0b0b4, State: Initialized, Role: FOLLOWER
I20260923 14:45:02.751227 6432 consensus_queue.cc:260] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43775 } }
I20260923 14:45:02.751379 6432 raft_consensus.cc:388] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:02.751462 6432 raft_consensus.cc:482] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:02.751576 6432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:02.752657 6432 raft_consensus.cc:504] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43775 } }
I20260923 14:45:02.753047 6432 leader_election.cc:302] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e56f6d5dd6874ec6b0b9b67cceb0b0b4; no voters:
I20260923 14:45:02.753374 6432 leader_election.cc:288] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:02.753489 6442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:02.753715 6442 raft_consensus.cc:686] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [term 1 LEADER]: Becoming Leader. State: Replica: e56f6d5dd6874ec6b0b9b67cceb0b0b4, State: Running, Role: LEADER
I20260923 14:45:02.754016 6442 consensus_queue.cc:237] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43775 } }
I20260923 14:45:02.754699 6432 sys_catalog.cc:564] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:02.755091 6443 sys_catalog.cc:455] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43775 } } }
I20260923 14:45:02.755112 6442 sys_catalog.cc:455] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e56f6d5dd6874ec6b0b9b67cceb0b0b4. Latest consensus state: current_term: 1 leader_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e56f6d5dd6874ec6b0b9b67cceb0b0b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43775 } } }
I20260923 14:45:02.755260 6442 sys_catalog.cc:458] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:02.755259 6443 sys_catalog.cc:458] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:02.755825 6446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:02.757658 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:02.752844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:34745 (local address 127.0.0.1:43775)
0923 14:45:02.752964 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:02.752968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:02.753136 (+ 168us) server_negotiation.cc:407] Connection header received
0923 14:45:02.753260 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:02.753264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:02.753319 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:02.753413 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:02.753743 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:02.754499 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:02.755631 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:02.755989 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:02.756077 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:02.757126 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:02.757129 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:02.757132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:02.757145 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:02.757174 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:02.757189 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:02.757250 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:02.757472 (+ 222us) server_negotiation.cc:299] Negotiation successful
0923 14:45:02.757504 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 14:45:02.759107 6446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:02.764101 6446 catalog_manager.cc:1347] Generated new cluster ID: db25b223d59749d38a80ca09c0ba1ade
I20260923 14:45:02.764166 6446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:02.792155 6446 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:02.793062 6446 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:02.798837 6446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e56f6d5dd6874ec6b0b9b67cceb0b0b4: Generated new TSK 0
I20260923 14:45:02.799589 6446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:02.810434 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6364
W20260923 14:45:02.815582 6349 connection.cc:535] client connection to 127.0.0.1:43775 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43775): Connection reset by peer (error 104)
2026-09-23T14:45:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:02 dist-test-slave-54kg krb5kdc[6463](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:02 dist-test-slave-54kg krb5kdc[6463](info): set up 2 sockets
Sep 23 14:45:02 dist-test-slave-54kg krb5kdc[6463](info): commencing operation
krb5kdc: starting...
W20260923 14:45:03.836912 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:03 dist-test-slave-54kg krb5kdc[6463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 14:45:03.955464 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:04.065186 6476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:04.065510 6476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:04.065600 6476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:04.069553 6476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:04.069640 6476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:04.069679 6476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:04.069715 6476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:04.069756 6476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:04.074946 6476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33297
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:04.076023 6476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:04.077025 6476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:04.085467 6481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:04.085563 6476 server_base.cc:1034] running on GCE node
W20260923 14:45:04.085482 6482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:04.085728 6484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:04.086262 6476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:04.087314 6476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:04.088500 6476 hybrid_clock.cc:648] HybridClock initialized: now 1790174704088485 us; error 27 us; skew 500 ppm
Sep 23 14:45:04 dist-test-slave-54kg krb5kdc[6463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:04.097786 6476 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 14:45:04.098793 6476 webserver.cc:460] Webserver started at http://127.0.0.1:44549/ using document root <none> and password file <none>
I20260923 14:45:04.099362 6476 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:04.099454 6476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:04.099689 6476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:04.101817 6476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "c7586e3db3f340eebd8435794ce8e8d6"
format_stamp: "Formatted at 2026-09-23 14:45:04 on dist-test-slave-54kg"
server_key: "4870f11ece91379799e5c77497c1f895"
server_key_iv: "3a8ef7201c978ca54a3d5a2bc7052def"
server_key_version: "encryptionkey@0"
I20260923 14:45:04.102363 6476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "c7586e3db3f340eebd8435794ce8e8d6"
format_stamp: "Formatted at 2026-09-23 14:45:04 on dist-test-slave-54kg"
server_key: "4870f11ece91379799e5c77497c1f895"
server_key_iv: "3a8ef7201c978ca54a3d5a2bc7052def"
server_key_version: "encryptionkey@0"
I20260923 14:45:04.105960 6476 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260923 14:45:04.108340 6491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:04.109542 6476 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:45:04.109680 6476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "c7586e3db3f340eebd8435794ce8e8d6"
format_stamp: "Formatted at 2026-09-23 14:45:04 on dist-test-slave-54kg"
server_key: "4870f11ece91379799e5c77497c1f895"
server_key_iv: "3a8ef7201c978ca54a3d5a2bc7052def"
server_key_version: "encryptionkey@0"
I20260923 14:45:04.109790 6476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:04.114429 6476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:04.117317 6476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:04.117518 6476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:04.124526 6476 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33297
I20260923 14:45:04.124550 6543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33297 every 8 connection(s)
I20260923 14:45:04.125396 6476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:04.128103 6544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:04.131345 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6476
I20260923 14:45:04.131484 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:04.131747 17426 external_mini_cluster.cc:1428] Setting key 625adb34e4bb1dbdb3cfed5ebdebd2bf
I20260923 14:45:04.133944 6544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6: Bootstrap starting.
I20260923 14:45:04.136518 6544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:04.137212 6547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:04.133261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:35877 (local address 127.0.0.1:33297)
0923 14:45:04.133698 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:04.133712 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:04.133747 (+ 35us) server_negotiation.cc:407] Connection header received
0923 14:45:04.134435 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:04.134453 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:04.134741 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:04.135031 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:04.135898 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:04.135903 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:04.135926 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:04.135937 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:04.136017 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:04.136039 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:04.136126 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:04.136267 (+ 141us) server_negotiation.cc:299] Negotiation successful
0923 14:45:04.136448 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":152,"threads_started":1}
I20260923 14:45:04.137235 6544 log.cc:824] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:04.139129 6544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6: No bootstrap required, opened a new log
I20260923 14:45:04.139808 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:04.143745 6547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:04.142074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.61:45865 (local address 127.0.0.1:33297)
0923 14:45:04.142210 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:04.142216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:04.142382 (+ 166us) server_negotiation.cc:407] Connection header received
0923 14:45:04.142486 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:04.142489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:04.142534 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:04.142642 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:04.143351 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:04.143354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:04.143357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:04.143369 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:04.143398 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:04.143410 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:04.143498 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:04.143588 (+ 90us) server_negotiation.cc:299] Negotiation successful
0923 14:45:04.143631 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:45:04.143579 6544 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7586e3db3f340eebd8435794ce8e8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33297 } }
I20260923 14:45:04.143877 6544 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:04.143934 6544 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7586e3db3f340eebd8435794ce8e8d6, State: Initialized, Role: FOLLOWER
I20260923 14:45:04.144374 6544 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7586e3db3f340eebd8435794ce8e8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33297 } }
I20260923 14:45:04.144541 6544 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:04.144616 6544 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:04.144734 6544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:04.145623 6544 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7586e3db3f340eebd8435794ce8e8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33297 } }
I20260923 14:45:04.145953 6544 leader_election.cc:302] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7586e3db3f340eebd8435794ce8e8d6; no voters:
I20260923 14:45:04.146245 6544 leader_election.cc:288] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:04.146371 6554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:04.146631 6554 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [term 1 LEADER]: Becoming Leader. State: Replica: c7586e3db3f340eebd8435794ce8e8d6, State: Running, Role: LEADER
I20260923 14:45:04.147049 6554 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7586e3db3f340eebd8435794ce8e8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33297 } }
I20260923 14:45:04.147542 6544 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:04.148747 6556 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7586e3db3f340eebd8435794ce8e8d6. Latest consensus state: current_term: 1 leader_uuid: "c7586e3db3f340eebd8435794ce8e8d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7586e3db3f340eebd8435794ce8e8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33297 } } }
I20260923 14:45:04.148793 6555 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7586e3db3f340eebd8435794ce8e8d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7586e3db3f340eebd8435794ce8e8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33297 } } }
I20260923 14:45:04.148888 6556 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:04.148888 6555 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:04.149287 6563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:04.152462 6563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:04.158259 6563 catalog_manager.cc:1347] Generated new cluster ID: 269f1204102244a7b2b7f808deab8fee
I20260923 14:45:04.158331 6563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:04.175619 6563 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:04.176010 6563 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:04.188457 6563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7586e3db3f340eebd8435794ce8e8d6: Generated new TSK 0
I20260923 14:45:04.189143 6563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:04.201102 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6476
2026-09-23T14:45:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1390 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:04 dist-test-slave-54kg krb5kdc[6575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:04 dist-test-slave-54kg krb5kdc[6575](info): set up 2 sockets
Sep 23 14:45:04 dist-test-slave-54kg krb5kdc[6575](info): commencing operation
krb5kdc: starting...
W20260923 14:45:05.233089 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:05 dist-test-slave-54kg krb5kdc[6575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:05.355283 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43979
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:43979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:05.462880 6588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:05.463194 6588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:05.463287 6588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:05.467340 6588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:05.467427 6588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:05.467471 6588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:05.467537 6588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:05.467574 6588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:05.472908 6588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:43979
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:05.473948 6588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:05.474967 6588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:05.483608 6593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:05.483636 6596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:05.483853 6588 server_base.cc:1034] running on GCE node
W20260923 14:45:05.483896 6594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:05.484427 6588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:05.485497 6588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:05.486687 6588 hybrid_clock.cc:648] HybridClock initialized: now 1790174705486661 us; error 39 us; skew 500 ppm
Sep 23 14:45:05 dist-test-slave-54kg krb5kdc[6575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:05.489610 6588 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:05.490618 6588 webserver.cc:460] Webserver started at http://127.17.4.190:37889/ using document root <none> and password file <none>
I20260923 14:45:05.491199 6588 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:05.491295 6588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:05.491508 6588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:05.493607 6588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "68fe841a5c17403a9444edd0d6103c59"
format_stamp: "Formatted at 2026-09-23 14:45:05 on dist-test-slave-54kg"
server_key: "f4151fa6a68df84d37a763884a2491ef"
server_key_iv: "434480b1c9caaafebff9aa822dcc76ec"
server_key_version: "encryptionkey@0"
I20260923 14:45:05.494180 6588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "68fe841a5c17403a9444edd0d6103c59"
format_stamp: "Formatted at 2026-09-23 14:45:05 on dist-test-slave-54kg"
server_key: "f4151fa6a68df84d37a763884a2491ef"
server_key_iv: "434480b1c9caaafebff9aa822dcc76ec"
server_key_version: "encryptionkey@0"
I20260923 14:45:05.497808 6588 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260923 14:45:05.500173 6603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:05.501531 6588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:45:05.501698 6588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "68fe841a5c17403a9444edd0d6103c59"
format_stamp: "Formatted at 2026-09-23 14:45:05 on dist-test-slave-54kg"
server_key: "f4151fa6a68df84d37a763884a2491ef"
server_key_iv: "434480b1c9caaafebff9aa822dcc76ec"
server_key_version: "encryptionkey@0"
I20260923 14:45:05.501811 6588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:05.520221 6588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:05.523032 6588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:05.523228 6588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:05.530027 6588 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:43979
I20260923 14:45:05.530092 6655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:43979 every 8 connection(s)
I20260923 14:45:05.530992 6588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:05.533690 6656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:05.538856 6656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59: Bootstrap starting.
I20260923 14:45:05.541117 6656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:05.541154 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6588
I20260923 14:45:05.541311 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:05.541574 17426 external_mini_cluster.cc:1428] Setting key de3f358c8ca7d2671d8d49a2600ebbc5
I20260923 14:45:05.541925 6656 log.cc:824] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:05.543901 6656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59: No bootstrap required, opened a new log
I20260923 14:45:05.547092 6656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fe841a5c17403a9444edd0d6103c59" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43979 } }
I20260923 14:45:05.547307 6656 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:05.547380 6656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68fe841a5c17403a9444edd0d6103c59, State: Initialized, Role: FOLLOWER
I20260923 14:45:05.547869 6656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fe841a5c17403a9444edd0d6103c59" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43979 } }
I20260923 14:45:05.548046 6656 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:05.548117 6656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:05.548216 6656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:05.549444 6656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fe841a5c17403a9444edd0d6103c59" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43979 } }
I20260923 14:45:05.549779 6656 leader_election.cc:302] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68fe841a5c17403a9444edd0d6103c59; no voters:
Sep 23 14:45:05 dist-test-slave-54kg krb5kdc[6575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:05.550114 6656 leader_election.cc:288] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:05.550180 6661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:05.550370 6661 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [term 1 LEADER]: Becoming Leader. State: Replica: 68fe841a5c17403a9444edd0d6103c59, State: Running, Role: LEADER
I20260923 14:45:05.550696 6661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fe841a5c17403a9444edd0d6103c59" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43979 } }
I20260923 14:45:05.551283 6656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:05.552428 6663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68fe841a5c17403a9444edd0d6103c59. Latest consensus state: current_term: 1 leader_uuid: "68fe841a5c17403a9444edd0d6103c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fe841a5c17403a9444edd0d6103c59" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43979 } } }
I20260923 14:45:05.552444 6662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68fe841a5c17403a9444edd0d6103c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68fe841a5c17403a9444edd0d6103c59" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43979 } } }
I20260923 14:45:05.552546 6663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:05.552565 6662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:05.552994 6670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:05.556380 6670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:05.557729 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:05.542623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41585 (local address 127.17.4.190:43979)
0923 14:45:05.542994 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:05.543009 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:05.543040 (+ 31us) server_negotiation.cc:407] Connection header received
0923 14:45:05.543641 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:05.543656 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:05.544090 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:05.544402 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:05.545163 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:05.546093 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:05.546931 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:05.547559 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:05.547738 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:05.550852 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:05.550857 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:05.550871 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:05.550900 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:05.554195 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:05.554785 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:05.554790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:05.554795 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:05.554952 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:05.555301 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:05.555304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:05.555306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:05.555827 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:05.556042 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:05.556357 (+ 315us) server_negotiation.cc:299] Negotiation successful
0923 14:45:05.556580 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
I20260923 14:45:05.560619 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:05.563020 6670 catalog_manager.cc:1347] Generated new cluster ID: 27635cf023da4fe59a21cb45af1c06d6
I20260923 14:45:05.563089 6670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:05.572512 6660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:05.563490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34923 (local address 127.17.4.190:43979)
0923 14:45:05.563605 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:05.563610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:05.563950 (+ 340us) server_negotiation.cc:407] Connection header received
0923 14:45:05.564140 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:05.564143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:05.564191 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:05.564274 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:05.564991 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:05.565779 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:05.566867 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:05.567205 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:05.567308 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:05.568842 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:05.568846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:05.568849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:05.568873 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:05.570450 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:05.570924 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:05.570927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:05.570929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:05.571007 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:05.571491 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:05.571494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:05.571496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:05.571699 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:05.571862 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:05.572119 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 14:45:05.572362 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260923 14:45:05.586548 6670 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:05.587414 6670 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:05.612057 6670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68fe841a5c17403a9444edd0d6103c59: Generated new TSK 0
I20260923 14:45:05.612804 6670 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:05.616766 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6588
W20260923 14:45:05.622242 6573 connection.cc:535] client connection to 127.17.4.190:43979 recv error: Network error: failed to read from TLS socket (remote: 127.17.4.190:43979): Connection reset by peer (error 104)
2026-09-23T14:45:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1415 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:05 dist-test-slave-54kg krb5kdc[6687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:05 dist-test-slave-54kg krb5kdc[6687](info): set up 2 sockets
Sep 23 14:45:05 dist-test-slave-54kg krb5kdc[6687](info): commencing operation
krb5kdc: starting...
W20260923 14:45:06.653002 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:06 dist-test-slave-54kg krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:06.770447 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46207
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:46143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:06.879871 6700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:06.880143 6700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:06.880211 6700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:06.884090 6700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:06.884160 6700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:06.884202 6700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:06.884258 6700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:06.884295 6700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:06.889497 6700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:46143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46207
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:06.890501 6700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:06.891479 6700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:06.899863 6708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:06.899991 6705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:06.900015 6700 server_base.cc:1034] running on GCE node
W20260923 14:45:06.900170 6706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:06.900743 6700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:06.901750 6700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:06.902949 6700 hybrid_clock.cc:648] HybridClock initialized: now 1790174706902936 us; error 24 us; skew 500 ppm
Sep 23 14:45:06 dist-test-slave-54kg krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:06.905646 6700 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:06.906606 6700 webserver.cc:460] Webserver started at http://127.17.4.190:38977/ using document root <none> and password file <none>
I20260923 14:45:06.907145 6700 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:06.907234 6700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:06.907462 6700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:06.909469 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "afce1e065ac3439d8a0a9fe06e02cebd"
format_stamp: "Formatted at 2026-09-23 14:45:06 on dist-test-slave-54kg"
server_key: "e7bcaa1221ca24730ed0c8f3026cd1ab"
server_key_iv: "931fdb2d0a4073f9ca5dad5e71ef20c0"
server_key_version: "encryptionkey@0"
I20260923 14:45:06.910028 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "afce1e065ac3439d8a0a9fe06e02cebd"
format_stamp: "Formatted at 2026-09-23 14:45:06 on dist-test-slave-54kg"
server_key: "e7bcaa1221ca24730ed0c8f3026cd1ab"
server_key_iv: "931fdb2d0a4073f9ca5dad5e71ef20c0"
server_key_version: "encryptionkey@0"
I20260923 14:45:06.913574 6700 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:45:06.915890 6715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:06.917137 6700 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:45:06.917281 6700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "afce1e065ac3439d8a0a9fe06e02cebd"
format_stamp: "Formatted at 2026-09-23 14:45:06 on dist-test-slave-54kg"
server_key: "e7bcaa1221ca24730ed0c8f3026cd1ab"
server_key_iv: "931fdb2d0a4073f9ca5dad5e71ef20c0"
server_key_version: "encryptionkey@0"
I20260923 14:45:06.917393 6700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:06.932565 6700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:06.935331 6700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:06.935532 6700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:06.942862 6700 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:46207
I20260923 14:45:06.942884 6767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:46207 every 8 connection(s)
I20260923 14:45:06.943887 6700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:06.946516 6768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:06.946859 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6700
I20260923 14:45:06.947005 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:06.947291 17426 external_mini_cluster.cc:1428] Setting key cd9680380be00e5924fae2d92846fb81
I20260923 14:45:06.952826 6768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd: Bootstrap starting.
I20260923 14:45:06.955053 6768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:06.955950 6768 log.cc:824] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:06.956244 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:06.948688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46565 (local address 127.17.4.190:46207)
0923 14:45:06.949123 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:06.949138 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:06.949172 (+ 34us) server_negotiation.cc:407] Connection header received
0923 14:45:06.949827 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:06.949842 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:06.950161 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:06.950491 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:06.950886 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:06.951936 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:06.952863 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:06.953375 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:06.953569 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:06.954479 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:06.954484 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:06.954495 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:06.954860 (+ 365us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:06.954912 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:06.954933 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:06.955079 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:06.955314 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 14:45:06.955447 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":127,"threads_started":1}
I20260923 14:45:06.957938 6768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd: No bootstrap required, opened a new log
I20260923 14:45:06.959115 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:06.962108 6768 raft_consensus.cc:348] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46207 } }
I20260923 14:45:06.962392 6768 raft_consensus.cc:374] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:06.962448 6768 raft_consensus.cc:729] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afce1e065ac3439d8a0a9fe06e02cebd, State: Initialized, Role: FOLLOWER
I20260923 14:45:06.962891 6768 consensus_queue.cc:260] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46207 } }
I20260923 14:45:06.963052 6768 raft_consensus.cc:388] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:06.963155 6768 raft_consensus.cc:482] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:06.963284 6768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:06.964550 6768 raft_consensus.cc:504] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46207 } }
I20260923 14:45:06.964937 6768 leader_election.cc:302] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afce1e065ac3439d8a0a9fe06e02cebd; no voters:
I20260923 14:45:06.965305 6768 leader_election.cc:288] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:06.965565 6778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:06.965606 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:06.961154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43053 (local address 127.17.4.190:46207)
0923 14:45:06.961279 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:06.961283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:06.961406 (+ 123us) server_negotiation.cc:407] Connection header received
0923 14:45:06.961481 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:06.961485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:06.961532 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:06.961623 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:06.961855 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:06.962643 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:06.963649 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:06.964009 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:06.964117 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:06.965002 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:06.965006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:06.965008 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:06.965027 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:06.965057 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:06.965072 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:06.965159 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:06.965399 (+ 240us) server_negotiation.cc:299] Negotiation successful
0923 14:45:06.965439 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:45:06.966132 6778 raft_consensus.cc:686] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [term 1 LEADER]: Becoming Leader. State: Replica: afce1e065ac3439d8a0a9fe06e02cebd, State: Running, Role: LEADER
I20260923 14:45:06.966442 6778 consensus_queue.cc:237] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46207 } }
I20260923 14:45:06.966706 6768 sys_catalog.cc:564] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:06.967612 6778 sys_catalog.cc:455] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader afce1e065ac3439d8a0a9fe06e02cebd. Latest consensus state: current_term: 1 leader_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46207 } } }
I20260923 14:45:06.967729 6778 sys_catalog.cc:458] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:06.968072 6779 sys_catalog.cc:455] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afce1e065ac3439d8a0a9fe06e02cebd" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46207 } } }
I20260923 14:45:06.968184 6779 sys_catalog.cc:458] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:06.968127 6787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:06.971206 6787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:06.976588 6787 catalog_manager.cc:1347] Generated new cluster ID: 378006081aff4d949c3db81b4c5da446
I20260923 14:45:06.976658 6787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:06.990666 6787 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:06.991909 6787 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:07.003154 6787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afce1e065ac3439d8a0a9fe06e02cebd: Generated new TSK 0
I20260923 14:45:07.003980 6787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:07.014156 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6700
W20260923 14:45:07.019634 6685 connection.cc:535] client connection to 127.17.4.190:46207 recv error: Network error: failed to read from TLS socket (remote: 127.17.4.190:46207): Connection reset by peer (error 104)
2026-09-23T14:45:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1397 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:07 dist-test-slave-54kg krb5kdc[6799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:07 dist-test-slave-54kg krb5kdc[6799](info): set up 2 sockets
Sep 23 14:45:07 dist-test-slave-54kg krb5kdc[6799](info): commencing operation
krb5kdc: starting...
W20260923 14:45:08.053133 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:08 dist-test-slave-54kg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:08.170569 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43561
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:43561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:08.276499 6812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:08.276757 6812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:08.276798 6812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:08.280650 6812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:08.280701 6812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:08.280720 6812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:08.280737 6812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:08.280751 6812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:08.285768 6812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:43561
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:08.286701 6812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:08.287633 6812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:08.296315 6817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:08.296329 6818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:08.296429 6812 server_base.cc:1034] running on GCE node
W20260923 14:45:08.296371 6820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:08.297039 6812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:08.298030 6812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:08.299186 6812 hybrid_clock.cc:648] HybridClock initialized: now 1790174708299169 us; error 30 us; skew 500 ppm
Sep 23 14:45:08 dist-test-slave-54kg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174708, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:08.301772 6812 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:08.302547 6812 webserver.cc:460] Webserver started at http://127.17.4.190:33235/ using document root <none> and password file <none>
I20260923 14:45:08.303030 6812 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:08.303085 6812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:08.303237 6812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:08.305187 6812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "422dca33570e4517b17f719e3a312ce1"
format_stamp: "Formatted at 2026-09-23 14:45:08 on dist-test-slave-54kg"
server_key: "a7e13a6cbfa7beb2eba7bfe8592e6c4e"
server_key_iv: "f797a1adcdaa8593a7add1268218a7d9"
server_key_version: "encryptionkey@0"
I20260923 14:45:08.305691 6812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "422dca33570e4517b17f719e3a312ce1"
format_stamp: "Formatted at 2026-09-23 14:45:08 on dist-test-slave-54kg"
server_key: "a7e13a6cbfa7beb2eba7bfe8592e6c4e"
server_key_iv: "f797a1adcdaa8593a7add1268218a7d9"
server_key_version: "encryptionkey@0"
I20260923 14:45:08.309113 6812 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 14:45:08.311301 6827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:08.312546 6812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:45:08.312640 6812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "422dca33570e4517b17f719e3a312ce1"
format_stamp: "Formatted at 2026-09-23 14:45:08 on dist-test-slave-54kg"
server_key: "a7e13a6cbfa7beb2eba7bfe8592e6c4e"
server_key_iv: "f797a1adcdaa8593a7add1268218a7d9"
server_key_version: "encryptionkey@0"
I20260923 14:45:08.312719 6812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:08.316953 6812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:08.319537 6812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:08.319674 6812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:08.326123 6812 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:43561
I20260923 14:45:08.326150 6879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:43561 every 8 connection(s)
I20260923 14:45:08.326999 6812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:08.329962 6880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:08.335475 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6812
I20260923 14:45:08.335521 6880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1: Bootstrap starting.
I20260923 14:45:08.335623 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:08.335979 17426 external_mini_cluster.cc:1428] Setting key 8dcb1046958d9498c18d95c273044664
I20260923 14:45:08.338212 6880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:08.338939 6880 log.cc:824] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:08.341351 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:08.337421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37685 (local address 127.17.4.190:43561)
0923 14:45:08.337854 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:08.337868 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:08.337901 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:45:08.338575 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:08.338592 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:08.338858 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:08.339192 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:08.339998 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:08.340003 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:08.340021 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:08.340037 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:08.340101 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:08.340126 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:08.340238 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:08.340362 (+ 124us) server_negotiation.cc:299] Negotiation successful
0923 14:45:08.340502 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":119,"threads_started":1}
I20260923 14:45:08.341364 6880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1: No bootstrap required, opened a new log
I20260923 14:45:08.344112 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:08.345479 6880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "422dca33570e4517b17f719e3a312ce1" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43561 } }
I20260923 14:45:08.345683 6880 raft_consensus.cc:374] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:08.345741 6880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422dca33570e4517b17f719e3a312ce1, State: Initialized, Role: FOLLOWER
I20260923 14:45:08.346216 6880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "422dca33570e4517b17f719e3a312ce1" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43561 } }
I20260923 14:45:08.346375 6880 raft_consensus.cc:388] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:08.346451 6880 raft_consensus.cc:482] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:08.346547 6880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:08.347411 6880 raft_consensus.cc:504] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "422dca33570e4517b17f719e3a312ce1" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43561 } }
I20260923 14:45:08.347796 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:08.346129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55347 (local address 127.17.4.190:43561)
0923 14:45:08.346251 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:08.346256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:08.346439 (+ 183us) server_negotiation.cc:407] Connection header received
0923 14:45:08.346528 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:08.346532 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:08.346563 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:08.346653 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:08.347367 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:08.347370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:08.347372 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:08.347383 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:08.347408 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:08.347421 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:08.347515 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:08.347606 (+ 91us) server_negotiation.cc:299] Negotiation successful
0923 14:45:08.347647 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 14:45:08.347800 6880 leader_election.cc:302] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 422dca33570e4517b17f719e3a312ce1; no voters:
I20260923 14:45:08.348186 6880 leader_election.cc:288] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:08.348297 6890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:08.348503 6890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [term 1 LEADER]: Becoming Leader. State: Replica: 422dca33570e4517b17f719e3a312ce1, State: Running, Role: LEADER
I20260923 14:45:08.348860 6890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "422dca33570e4517b17f719e3a312ce1" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43561 } }
I20260923 14:45:08.349355 6880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:08.350461 6892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 422dca33570e4517b17f719e3a312ce1. Latest consensus state: current_term: 1 leader_uuid: "422dca33570e4517b17f719e3a312ce1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "422dca33570e4517b17f719e3a312ce1" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43561 } } }
I20260923 14:45:08.350577 6892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:08.350961 6899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:08.350951 6891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "422dca33570e4517b17f719e3a312ce1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "422dca33570e4517b17f719e3a312ce1" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43561 } } }
I20260923 14:45:08.351575 6891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:08.353967 6899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:08.359306 6899 catalog_manager.cc:1347] Generated new cluster ID: 7ccddeb22c8a4b6b853437a01395bed5
I20260923 14:45:08.359397 6899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:08.377373 6899 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:08.377681 6899 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:08.384076 6899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 422dca33570e4517b17f719e3a312ce1: Generated new TSK 0
I20260923 14:45:08.384780 6899 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:08.393400 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6812
2026-09-23T14:45:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1378 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:08 dist-test-slave-54kg krb5kdc[6911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:08 dist-test-slave-54kg krb5kdc[6911](info): set up 2 sockets
Sep 23 14:45:08 dist-test-slave-54kg krb5kdc[6911](info): commencing operation
krb5kdc: starting...
W20260923 14:45:09.425072 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:09 dist-test-slave-54kg krb5kdc[6911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:09.548758 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:41959
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:35463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:41959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:09.657621 6924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:09.657891 6924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:09.657970 6924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:09.661952 6924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:09.662030 6924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:09.662065 6924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:09.662125 6924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:09.662163 6924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:09.667317 6924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:35463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:41959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:41959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:09.668365 6924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:09.669318 6924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:09.677425 6929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:09.677584 6930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:09.677611 6924 server_base.cc:1034] running on GCE node
W20260923 14:45:09.677443 6932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:09.678290 6924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:09.679380 6924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:09.680583 6924 hybrid_clock.cc:648] HybridClock initialized: now 1790174709680553 us; error 43 us; skew 500 ppm
Sep 23 14:45:09 dist-test-slave-54kg krb5kdc[6911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174709, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:09.688681 6924 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:09.689530 6924 webserver.cc:460] Webserver started at http://127.17.4.190:41573/ using document root <none> and password file <none>
I20260923 14:45:09.690088 6924 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:09.690186 6924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:09.690407 6924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:09.692495 6924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "bf96a29b7ebd4f699c5bd2545733ec4d"
format_stamp: "Formatted at 2026-09-23 14:45:09 on dist-test-slave-54kg"
server_key: "2fc9aae7967a6c9ef56a8dc68915dd88"
server_key_iv: "ff637e02c1dc412ff66962d2b20827b0"
server_key_version: "encryptionkey@0"
I20260923 14:45:09.693156 6924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "bf96a29b7ebd4f699c5bd2545733ec4d"
format_stamp: "Formatted at 2026-09-23 14:45:09 on dist-test-slave-54kg"
server_key: "2fc9aae7967a6c9ef56a8dc68915dd88"
server_key_iv: "ff637e02c1dc412ff66962d2b20827b0"
server_key_version: "encryptionkey@0"
I20260923 14:45:09.696806 6924 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:45:09.699111 6939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:09.700506 6924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:45:09.700663 6924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "bf96a29b7ebd4f699c5bd2545733ec4d"
format_stamp: "Formatted at 2026-09-23 14:45:09 on dist-test-slave-54kg"
server_key: "2fc9aae7967a6c9ef56a8dc68915dd88"
server_key_iv: "ff637e02c1dc412ff66962d2b20827b0"
server_key_version: "encryptionkey@0"
I20260923 14:45:09.700798 6924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:09.716533 6924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:09.719264 6924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:09.719409 6924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:09.726316 6924 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:41959
I20260923 14:45:09.726331 6991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:41959 every 8 connection(s)
I20260923 14:45:09.727244 6924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:09.729894 6992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:09.734844 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 6924
I20260923 14:45:09.734994 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:09.735137 6992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d: Bootstrap starting.
I20260923 14:45:09.735329 17426 external_mini_cluster.cc:1428] Setting key 05e380cdbc5046b4df40a7eca33ff7a2
I20260923 14:45:09.737680 6992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:09.738493 6992 log.cc:824] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:09.740581 6992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d: No bootstrap required, opened a new log
Sep 23 14:45:09 dist-test-slave-54kg krb5kdc[6911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:09.744933 6992 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41959 } }
I20260923 14:45:09.745136 6992 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:09.745213 6992 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf96a29b7ebd4f699c5bd2545733ec4d, State: Initialized, Role: FOLLOWER
I20260923 14:45:09.745740 6992 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41959 } }
I20260923 14:45:09.745936 6992 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:09.746016 6992 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:09.746129 6992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:09.747262 6992 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41959 } }
I20260923 14:45:09.747648 6992 leader_election.cc:302] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf96a29b7ebd4f699c5bd2545733ec4d; no voters:
I20260923 14:45:09.748006 6992 leader_election.cc:288] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:09.748128 6997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:09.748376 6997 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [term 1 LEADER]: Becoming Leader. State: Replica: bf96a29b7ebd4f699c5bd2545733ec4d, State: Running, Role: LEADER
I20260923 14:45:09.748680 6997 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41959 } }
I20260923 14:45:09.749284 6992 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:09.749855 6998 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf96a29b7ebd4f699c5bd2545733ec4d. Latest consensus state: current_term: 1 leader_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41959 } } }
I20260923 14:45:09.749969 6998 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:09.750351 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:09.736603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58005 (local address 127.17.4.190:41959)
0923 14:45:09.736993 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:09.737019 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:09.737059 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:45:09.737666 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:09.737681 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:09.738047 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:09.738316 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:09.739210 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:09.740263 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:09.741397 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:09.741864 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:09.741981 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:09.744798 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:09.744803 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:09.744814 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:09.744839 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:09.746945 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:09.747367 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:09.747373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:09.747378 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:09.747513 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:09.747789 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:09.747792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:09.747794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:09.748296 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:09.748472 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:09.748959 (+ 487us) server_negotiation.cc:299] Negotiation successful
0923 14:45:09.749232 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":124,"threads_started":1}
I20260923 14:45:09.750569 6999 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf96a29b7ebd4f699c5bd2545733ec4d" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 41959 } } }
I20260923 14:45:09.750686 6999 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:09.750924 7004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:09.753561 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:09.753911 7004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:09.759544 7004 catalog_manager.cc:1347] Generated new cluster ID: 3df4e412467e4ec8ba204f95ff7beefb
I20260923 14:45:09.759609 7004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:09.765806 7004 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:09.766201 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:09.755658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57631 (local address 127.17.4.190:41959)
0923 14:45:09.755783 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:09.755788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:09.757985 (+ 2197us) server_negotiation.cc:407] Connection header received
0923 14:45:09.758104 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:09.758107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:09.758152 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:09.758257 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:09.758883 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:09.759489 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:09.760584 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:09.760954 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:09.761077 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:09.762444 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:09.762448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:09.762451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:09.762474 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:09.764110 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:09.764567 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:09.764571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:09.764572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:09.764677 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:09.764982 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:09.764985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:09.764986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:09.765189 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:09.765313 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:09.765957 (+ 644us) server_negotiation.cc:299] Negotiation successful
0923 14:45:09.766061 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:45:09.767192 7004 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:09.773650 7004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf96a29b7ebd4f699c5bd2545733ec4d: Generated new TSK 0
I20260923 14:45:09.774307 7004 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:09.780506 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 6924
2026-09-23T14:45:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1387 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:09 dist-test-slave-54kg krb5kdc[7023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:09 dist-test-slave-54kg krb5kdc[7023](info): set up 2 sockets
Sep 23 14:45:09 dist-test-slave-54kg krb5kdc[7023](info): commencing operation
krb5kdc: starting...
W20260923 14:45:10.817162 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:10 dist-test-slave-54kg krb5kdc[7023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:10.934825 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43425
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:43425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:11.044277 7036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:11.044606 7036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:11.044678 7036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:11.048763 7036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:11.048871 7036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:11.048911 7036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:11.048949 7036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:11.048983 7036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:11.054486 7036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:43425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:43425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:11.055634 7036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:11.056766 7036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:11.065506 7044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:11.065519 7041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:11.065526 7042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:11.065711 7036 server_base.cc:1034] running on GCE node
I20260923 14:45:11.066274 7036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:11.067328 7036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:11.068486 7036 hybrid_clock.cc:648] HybridClock initialized: now 1790174711068468 us; error 31 us; skew 500 ppm
Sep 23 14:45:11 dist-test-slave-54kg krb5kdc[7023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174711, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:11.071209 7036 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:11.072080 7036 webserver.cc:460] Webserver started at http://127.17.4.190:36153/ using document root <none> and password file <none>
I20260923 14:45:11.072582 7036 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:11.072638 7036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:11.072791 7036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:11.074730 7036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "443b95b2d48d406cb6ff045c74422aed"
format_stamp: "Formatted at 2026-09-23 14:45:11 on dist-test-slave-54kg"
server_key: "d03aea6cf67200a6147ef6bf8b3b68be"
server_key_iv: "0ba1591ccbb60db641d7fe57fee6dfc1"
server_key_version: "encryptionkey@0"
I20260923 14:45:11.075242 7036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "443b95b2d48d406cb6ff045c74422aed"
format_stamp: "Formatted at 2026-09-23 14:45:11 on dist-test-slave-54kg"
server_key: "d03aea6cf67200a6147ef6bf8b3b68be"
server_key_iv: "0ba1591ccbb60db641d7fe57fee6dfc1"
server_key_version: "encryptionkey@0"
I20260923 14:45:11.078955 7036 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 14:45:11.081426 7051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:11.082665 7036 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:45:11.082808 7036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "443b95b2d48d406cb6ff045c74422aed"
format_stamp: "Formatted at 2026-09-23 14:45:11 on dist-test-slave-54kg"
server_key: "d03aea6cf67200a6147ef6bf8b3b68be"
server_key_iv: "0ba1591ccbb60db641d7fe57fee6dfc1"
server_key_version: "encryptionkey@0"
I20260923 14:45:11.082926 7036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:11.092561 7036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:11.095296 7036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:11.095504 7036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:11.102586 7036 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:43425
I20260923 14:45:11.102651 7103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:43425 every 8 connection(s)
I20260923 14:45:11.103554 7036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:11.106379 7104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:11.110908 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7036
I20260923 14:45:11.111055 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:11.111367 17426 external_mini_cluster.cc:1428] Setting key fa10c046dc582a8c3e54dc95a1114294
I20260923 14:45:11.112504 7104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed: Bootstrap starting.
I20260923 14:45:11.115235 7104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:11.116185 7104 log.cc:824] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:11.118253 7104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed: No bootstrap required, opened a new log
I20260923 14:45:11.121558 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:11.112816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56923 (local address 127.17.4.190:43425)
0923 14:45:11.113227 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:11.113247 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:11.113287 (+ 40us) server_negotiation.cc:407] Connection header received
0923 14:45:11.114161 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:11.114184 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:11.114622 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:11.114971 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:11.115408 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:11.116856 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:11.117800 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:11.118468 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:11.118651 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:11.119434 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:11.119441 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:11.119457 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:11.120015 (+ 558us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:11.120079 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:11.120112 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:11.120211 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:11.120312 (+ 101us) server_negotiation.cc:299] Negotiation successful
0923 14:45:11.120541 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":104,"threads_started":1}
I20260923 14:45:11.122916 7104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b95b2d48d406cb6ff045c74422aed" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43425 } }
I20260923 14:45:11.123140 7104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:11.123204 7104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443b95b2d48d406cb6ff045c74422aed, State: Initialized, Role: FOLLOWER
I20260923 14:45:11.123704 7104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b95b2d48d406cb6ff045c74422aed" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43425 } }
I20260923 14:45:11.123888 7104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:11.123956 7104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:11.124092 7104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:11.124639 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:11.125213 7104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b95b2d48d406cb6ff045c74422aed" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43425 } }
I20260923 14:45:11.125571 7104 leader_election.cc:302] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 443b95b2d48d406cb6ff045c74422aed; no voters:
I20260923 14:45:11.125905 7104 leader_election.cc:288] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:11.126001 7111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:11.126276 7111 raft_consensus.cc:686] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [term 1 LEADER]: Becoming Leader. State: Replica: 443b95b2d48d406cb6ff045c74422aed, State: Running, Role: LEADER
I20260923 14:45:11.126663 7111 consensus_queue.cc:237] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b95b2d48d406cb6ff045c74422aed" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43425 } }
I20260923 14:45:11.127213 7104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:11.127911 7111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 443b95b2d48d406cb6ff045c74422aed. Latest consensus state: current_term: 1 leader_uuid: "443b95b2d48d406cb6ff045c74422aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b95b2d48d406cb6ff045c74422aed" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43425 } } }
I20260923 14:45:11.128037 7111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:11.128328 7114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "443b95b2d48d406cb6ff045c74422aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b95b2d48d406cb6ff045c74422aed" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 43425 } } }
I20260923 14:45:11.128439 7114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:11.128475 7122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:11.131610 7122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:11.133315 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:11.126854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53873 (local address 127.17.4.190:43425)
0923 14:45:11.126959 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:11.126963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:11.128251 (+ 1288us) server_negotiation.cc:407] Connection header received
0923 14:45:11.128532 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:11.128536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:11.128582 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:11.128636 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:11.129155 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:11.129999 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:11.131176 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:11.131478 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:11.131607 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:11.132613 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:11.132617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:11.132619 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:11.132633 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:11.132661 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:11.132673 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:11.132745 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:11.133127 (+ 382us) server_negotiation.cc:299] Negotiation successful
0923 14:45:11.133185 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 14:45:11.137193 7122 catalog_manager.cc:1347] Generated new cluster ID: ead84ad22364488aad5b62ae6b0eeeee
I20260923 14:45:11.137259 7122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:11.150143 7122 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:11.151094 7122 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:11.156418 7122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 443b95b2d48d406cb6ff045c74422aed: Generated new TSK 0
I20260923 14:45:11.157115 7122 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:11.161604 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7036
2026-09-23T14:45:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:11 dist-test-slave-54kg krb5kdc[7135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:11 dist-test-slave-54kg krb5kdc[7135](info): set up 2 sockets
Sep 23 14:45:11 dist-test-slave-54kg krb5kdc[7135](info): commencing operation
krb5kdc: starting...
W20260923 14:45:12.197115 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:12 dist-test-slave-54kg krb5kdc[7135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:12.314814 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35361
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:39083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:35361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:12.423676 7148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:12.424027 7148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:12.424069 7148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:12.427896 7148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:12.427942 7148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:12.427960 7148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:12.427976 7148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:12.427990 7148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:12.433161 7148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:39083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:35361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:35361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:12.434113 7148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:12.435029 7148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:45:12.443543 7148 server_base.cc:1034] running on GCE node
W20260923 14:45:12.443508 7154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:12.443506 7153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:12.443531 7156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:12.444358 7148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:12.445474 7148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:12.446638 7148 hybrid_clock.cc:648] HybridClock initialized: now 1790174712446614 us; error 43 us; skew 500 ppm
Sep 23 14:45:12 dist-test-slave-54kg krb5kdc[7135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:12.449416 7148 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:12.450388 7148 webserver.cc:460] Webserver started at http://127.17.4.190:34681/ using document root <none> and password file <none>
I20260923 14:45:12.450950 7148 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:12.451036 7148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:12.451254 7148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:12.453377 7148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "aaf491c10d7e43f9a05a5a74b5a49810"
format_stamp: "Formatted at 2026-09-23 14:45:12 on dist-test-slave-54kg"
server_key: "b3a1545c7da349c9b1c749ccde8b5860"
server_key_iv: "7c08888ac91a7d3e857e464c5ee74e54"
server_key_version: "encryptionkey@0"
I20260923 14:45:12.453938 7148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "aaf491c10d7e43f9a05a5a74b5a49810"
format_stamp: "Formatted at 2026-09-23 14:45:12 on dist-test-slave-54kg"
server_key: "b3a1545c7da349c9b1c749ccde8b5860"
server_key_iv: "7c08888ac91a7d3e857e464c5ee74e54"
server_key_version: "encryptionkey@0"
I20260923 14:45:12.457617 7148 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:45:12.460059 7163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:12.461215 7148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:45:12.461352 7148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "aaf491c10d7e43f9a05a5a74b5a49810"
format_stamp: "Formatted at 2026-09-23 14:45:12 on dist-test-slave-54kg"
server_key: "b3a1545c7da349c9b1c749ccde8b5860"
server_key_iv: "7c08888ac91a7d3e857e464c5ee74e54"
server_key_version: "encryptionkey@0"
I20260923 14:45:12.461463 7148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:12.466042 7148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:12.468937 7148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:12.469141 7148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:12.476250 7148 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:35361
I20260923 14:45:12.476276 7215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:35361 every 8 connection(s)
I20260923 14:45:12.477161 7148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:12.479723 7216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:12.480407 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7148
I20260923 14:45:12.480533 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:12.480806 17426 external_mini_cluster.cc:1428] Setting key 998b7e76578963e39bed63e6f4a1724a
I20260923 14:45:12.486176 7219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:12.482137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59737 (local address 127.17.4.190:35361)
0923 14:45:12.482543 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:12.482562 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:12.482607 (+ 45us) server_negotiation.cc:407] Connection header received
0923 14:45:12.483405 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:12.483427 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:12.483756 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:12.484115 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:12.484859 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:12.484865 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:12.484880 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:12.484891 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:12.484965 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:12.484991 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:12.485126 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:12.485196 (+ 70us) server_negotiation.cc:299] Negotiation successful
0923 14:45:12.485339 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":105,"threads_started":1}
I20260923 14:45:12.486367 7216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810: Bootstrap starting.
I20260923 14:45:12.488880 7216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:12.489023 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:12.489630 7216 log.cc:824] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:12.491914 7216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810: No bootstrap required, opened a new log
I20260923 14:45:12.492718 7219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:12.491039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57013 (local address 127.17.4.190:35361)
0923 14:45:12.491163 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:12.491167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:12.491326 (+ 159us) server_negotiation.cc:407] Connection header received
0923 14:45:12.491441 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:12.491443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:12.491469 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:12.491533 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:12.492316 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:12.492318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:12.492321 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 14:45:12.492331 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:12.492354 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 14:45:12.492363 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:12.492431 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:12.492544 (+ 113us) server_negotiation.cc:299] Negotiation successful
0923 14:45:12.492573 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:45:12.495967 7216 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35361 } }
I20260923 14:45:12.496206 7216 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 14:45:12.496263 7216 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf491c10d7e43f9a05a5a74b5a49810, State: Initialized, Role: FOLLOWER
I20260923 14:45:12.496654 7216 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35361 } }
I20260923 14:45:12.496799 7216 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 14:45:12.496888 7216 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 14:45:12.496989 7216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:12.498208 7216 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35361 } }
I20260923 14:45:12.498625 7216 leader_election.cc:302] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaf491c10d7e43f9a05a5a74b5a49810; no voters:
I20260923 14:45:12.498955 7216 leader_election.cc:288] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 14:45:12.499083 7226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:12.499308 7226 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [term 1 LEADER]: Becoming Leader. State: Replica: aaf491c10d7e43f9a05a5a74b5a49810, State: Running, Role: LEADER
I20260923 14:45:12.499596 7226 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35361 } }
I20260923 14:45:12.500213 7216 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:12.501308 7228 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaf491c10d7e43f9a05a5a74b5a49810. Latest consensus state: current_term: 1 leader_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35361 } } }
I20260923 14:45:12.501426 7228 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:12.501721 7227 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf491c10d7e43f9a05a5a74b5a49810" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 35361 } } }
I20260923 14:45:12.501821 7227 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:12.502084 7235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:12.505182 7235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:12.510545 7235 catalog_manager.cc:1347] Generated new cluster ID: b7a23b81d91c433c9428a584ef04a4af
I20260923 14:45:12.510615 7235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:12.532109 7235 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:12.532495 7235 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:12.539461 7235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaf491c10d7e43f9a05a5a74b5a49810: Generated new TSK 0
I20260923 14:45:12.540196 7235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 14:45:12.545420 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7148
2026-09-23T14:45:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1384 ms)
[----------] 18 tests from AuthTokenIssuingTest (25252 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:12 dist-test-slave-54kg krb5kdc[7247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:12 dist-test-slave-54kg krb5kdc[7247](info): set up 2 sockets
Sep 23 14:45:12 dist-test-slave-54kg krb5kdc[7247](info): commencing operation
krb5kdc: starting...
W20260923 14:45:13.589210 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:13 dist-test-slave-54kg krb5kdc[7247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:13.715140 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:37355
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:37355,127.17.4.189:39249,127.17.4.188:36071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:13.822206 7260 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 14:45:13.822479 7260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:13.822502 7260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:13.822548 7260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:13.826424 7260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:13.826480 7260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:13.826499 7260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:13.826515 7260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:13.826536 7260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:13.831588 7260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:37355,127.17.4.189:39249,127.17.4.188:36071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:37355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:13.832645 7260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:13.833601 7260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:13.842062 7265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:13.842195 7260 server_base.cc:1034] running on GCE node
W20260923 14:45:13.842095 7266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:13.842078 7268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:13.842998 7260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:13.844197 7260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:13.845396 7260 hybrid_clock.cc:648] HybridClock initialized: now 1790174713845366 us; error 41 us; skew 500 ppm
Sep 23 14:45:13 dist-test-slave-54kg krb5kdc[7247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:13.848204 7260 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:13.849020 7260 webserver.cc:460] Webserver started at http://127.17.4.190:46689/ using document root <none> and password file <none>
I20260923 14:45:13.849520 7260 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:13.849576 7260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:13.849732 7260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:13.851699 7260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "ccdb5c03fc934549b10faf89b1dd5844"
format_stamp: "Formatted at 2026-09-23 14:45:13 on dist-test-slave-54kg"
server_key: "975ef8bd830d8dff57b899ac4141b0c4"
server_key_iv: "cf3f0c54d239a11bbfbaf580d7cfd786"
server_key_version: "encryptionkey@0"
I20260923 14:45:13.852308 7260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "ccdb5c03fc934549b10faf89b1dd5844"
format_stamp: "Formatted at 2026-09-23 14:45:13 on dist-test-slave-54kg"
server_key: "975ef8bd830d8dff57b899ac4141b0c4"
server_key_iv: "cf3f0c54d239a11bbfbaf580d7cfd786"
server_key_version: "encryptionkey@0"
I20260923 14:45:13.855762 7260 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:45:13.858186 7275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:13.859390 7260 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:45:13.859524 7260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "ccdb5c03fc934549b10faf89b1dd5844"
format_stamp: "Formatted at 2026-09-23 14:45:13 on dist-test-slave-54kg"
server_key: "975ef8bd830d8dff57b899ac4141b0c4"
server_key_iv: "cf3f0c54d239a11bbfbaf580d7cfd786"
server_key_version: "encryptionkey@0"
I20260923 14:45:13.859622 7260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:13.869783 7260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:13.872862 7260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:13.873070 7260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:13.879688 7260 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:37355
I20260923 14:45:13.880013 7327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:37355 every 8 connection(s)
I20260923 14:45:13.880762 7260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:13.883390 7328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:13.886977 7328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:13.891106 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7260
I20260923 14:45:13.891260 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:13.891563 17426 external_mini_cluster.cc:1428] Setting key bd74d297a927a7d57d92b3866b6b9aee
Sep 23 14:45:13 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.189@KRBTEST.COM" created.
I20260923 14:45:13.903123 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:13.889057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37355 (local address 127.0.0.1:37230)
0923 14:45:13.889528 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:13.889584 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:13.890396 (+ 812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:13.891122 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:13.891126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:13.891578 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:13.891955 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:13.891971 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:13.893684 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:13.893690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:13.894937 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:13.894951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:13.895623 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:13.895635 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:13.895836 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:13.896472 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:13.896498 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:13.898176 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:13.900165 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:13.900175 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:13.900185 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:13.900401 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:13.900725 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:13.900728 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:13.900730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:13.900840 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:13.901449 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:13.901455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:13.901592 (+ 137us) client_negotiation.cc:769] Sending connection context
0923 14:45:13.901764 (+ 172us) client_negotiation.cc:240] Negotiation successful
0923 14:45:13.902139 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":105,"spinlock_wait_cycles":16256,"thread_start_us":168,"threads_started":1}
I20260923 14:45:13.903123 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:13.889058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37230 (local address 127.17.4.190:37355)
0923 14:45:13.889469 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:13.889484 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:13.889712 (+ 228us) server_negotiation.cc:407] Connection header received
0923 14:45:13.890658 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:13.890663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:13.890906 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:13.891124 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:13.892112 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:13.893513 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:13.895067 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:13.895449 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:13.895564 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:13.898329 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:13.898335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:13.898344 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:13.898364 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:13.900045 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:13.900510 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:13.900518 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:13.900524 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:13.900626 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:13.900948 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:13.900951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:13.900952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:13.901301 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:13.901462 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:13.901822 (+ 360us) server_negotiation.cc:299] Negotiation successful
0923 14:45:13.902063 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":134,"threads_started":1}
I20260923 14:45:13.905503 7328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:13.906271 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:13.906017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38064)
0923 14:45:13.906138 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:13.906212 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 14:45:13.906461 7277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
I20260923 14:45:13.907326 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:13.907119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38074)
0923 14:45:13.907224 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:13.907275 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 14:45:13.907487 7328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:39249: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab.
Entry for principal kudu/127.17.4.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab.
I20260923 14:45:13.918520 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:39249
--webserver_interface=127.17.4.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab
--principal=kudu/127.17.4.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:37355,127.17.4.189:39249,127.17.4.188:36071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:45:13.956733 7328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } attempt: 1
I20260923 14:45:13.957719 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:13.957331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38090)
0923 14:45:13.957525 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:13.957618 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260923 14:45:13.958465 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:13.958245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38094)
0923 14:45:13.958352 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:13.958404 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 14:45:13.958624 7328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:39249: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
I20260923 14:45:14.026816 7328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } attempt: 2
I20260923 14:45:14.027740 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.027366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38102)
0923 14:45:14.027542 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.027614 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 14:45:14.028468 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.028246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38106)
0923 14:45:14.028349 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.028400 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 14:45:14.028604 7328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:39249: Network error: Client connection negotiation failed: client connection to 127.17.4.189:39249: connect: Connection refused (error 111)
W20260923 14:45:14.028426 7335 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 14:45:14.028816 7335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:14.028865 7335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:14.028946 7335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:14.033026 7335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:14.033082 7335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:14.033102 7335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:14.033118 7335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:14.033133 7335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:14.038452 7335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:37355,127.17.4.189:39249,127.17.4.188:36071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab
--principal=kudu/127.17.4.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:39249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.4.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:14.039456 7335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:14.040506 7335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:14.048787 7343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:14.048790 7340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:14.048795 7341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:14.049189 7335 server_base.cc:1034] running on GCE node
I20260923 14:45:14.049722 7335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:14.050789 7335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:14.051964 7335 hybrid_clock.cc:648] HybridClock initialized: now 1790174714051951 us; error 28 us; skew 500 ppm
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:14.054772 7335 init.cc:377] Logged in from keytab as kudu/127.17.4.189@KRBTEST.COM (short username kudu)
I20260923 14:45:14.055697 7335 webserver.cc:460] Webserver started at http://127.17.4.189:34651/ using document root <none> and password file <none>
I20260923 14:45:14.056303 7335 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:14.056398 7335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:14.056631 7335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:14.058653 7335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data/instance:
uuid: "b65c9eb0d3784f4497a91c1e3981f89d"
format_stamp: "Formatted at 2026-09-23 14:45:14 on dist-test-slave-54kg"
server_key: "6a69a92385672af9691118211a08228e"
server_key_iv: "6dd5525bee0f38ee6d4e39a9b1302334"
server_key_version: "encryptionkey@0"
I20260923 14:45:14.059216 7335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal/instance:
uuid: "b65c9eb0d3784f4497a91c1e3981f89d"
format_stamp: "Formatted at 2026-09-23 14:45:14 on dist-test-slave-54kg"
server_key: "6a69a92385672af9691118211a08228e"
server_key_iv: "6dd5525bee0f38ee6d4e39a9b1302334"
server_key_version: "encryptionkey@0"
I20260923 14:45:14.062867 7335 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 14:45:14.065409 7350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:14.066603 7335 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 14:45:14.066740 7335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal
uuid: "b65c9eb0d3784f4497a91c1e3981f89d"
format_stamp: "Formatted at 2026-09-23 14:45:14 on dist-test-slave-54kg"
server_key: "6a69a92385672af9691118211a08228e"
server_key_iv: "6dd5525bee0f38ee6d4e39a9b1302334"
server_key_version: "encryptionkey@0"
I20260923 14:45:14.066846 7335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:14.106164 7335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:14.109705 7335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:14.109942 7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:14.117319 7335 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.189:39249
I20260923 14:45:14.117621 7402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.189:39249 every 8 connection(s)
I20260923 14:45:14.118393 7335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
I20260923 14:45:14.119800 7328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } attempt: 3
I20260923 14:45:14.121681 7403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:14.125224 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7335
I20260923 14:45:14.125366 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-1/wal/instance
I20260923 14:45:14.125660 17426 external_mini_cluster.cc:1428] Setting key 40438309af4d00d3433b320b302208a4
I20260923 14:45:14.125778 7403 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:14.133213 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.120379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38122)
0923 14:45:14.120549 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.120568 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.120667 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.122978 (+ 2311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.122981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.123186 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.123312 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.123320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.124776 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.124780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.125409 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.125422 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.126285 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.126289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.126395 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.126943 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.126958 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.128641 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.131151 (+ 2510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.131154 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.131155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.131408 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.131794 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.131800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.131804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.131901 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.132695 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.132700 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.132777 (+ 77us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.132905 (+ 128us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.133046 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 14:45:14.134124 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.121149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38122 (local address 127.17.4.189:39249)
0923 14:45:14.121585 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.121600 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.121635 (+ 35us) server_negotiation.cc:407] Connection header received
0923 14:45:14.122357 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.122375 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.122700 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.123043 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.123479 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.124647 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.125575 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.126115 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.126292 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.128838 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.128843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.128854 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.128880 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.131015 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.131526 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.131532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.131538 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.131668 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.132007 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.132017 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.132019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.132531 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.132650 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.133054 (+ 404us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.133339 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":153,"threads_started":1}
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.4.188@KRBTEST.COM; defaulting to no policy
I20260923 14:45:14.136327 7328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:14.137096 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.136842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:58928)
0923 14:45:14.136977 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.137029 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260923 14:45:14.137845 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.137611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:58942)
0923 14:45:14.137744 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.137790 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260923 14:45:14.138041 7328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:36071: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.188@KRBTEST.COM" created.
I20260923 14:45:14.139712 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.127854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37234 (local address 127.17.4.190:37355)
0923 14:45:14.127990 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.127995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.128651 (+ 656us) server_negotiation.cc:407] Connection header received
0923 14:45:14.128801 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.128807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.128861 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.128942 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.129780 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.130636 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.132136 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.132481 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.132605 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.135557 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.135561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.135563 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.135592 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.137871 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.138395 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.138400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.138403 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.138486 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.138789 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.138796 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.138800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.138989 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.139103 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.139457 (+ 354us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.139574 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:45:14.139789 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.127822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37355 (local address 127.0.0.1:37234)
0923 14:45:14.128497 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.128551 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.128687 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.128993 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.128999 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.129414 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.129591 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.129603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.130771 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.130775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.132005 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.132021 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.132615 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.132620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.132759 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.133644 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.133662 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.135406 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.138005 (+ 2599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.138015 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.138022 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.138289 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.138593 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.138597 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.138599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.138691 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.139104 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.139111 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.139230 (+ 119us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.139385 (+ 155us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.139579 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":157,"threads_started":1}
I20260923 14:45:14.140827 7403 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:14.148784 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.141333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38136)
0923 14:45:14.141432 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.141448 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.141525 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.141750 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.141753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.141941 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.142022 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.142027 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.142729 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.142732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.143226 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.143232 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.143680 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.143684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.143843 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.144297 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.144307 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.145661 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.147316 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.147319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.147320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.147553 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.147847 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.147849 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.147851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.147955 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.148357 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.148367 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.148445 (+ 78us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.148528 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.148658 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":22}
I20260923 14:45:14.148980 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.141397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38136 (local address 127.17.4.189:39249)
0923 14:45:14.141501 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.141504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.141516 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:45:14.141612 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.141615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.141653 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.141740 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.142130 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.142623 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.143334 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.143577 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.143683 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.145812 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.145819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.145823 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.145855 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.147216 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.147639 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.147642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.147643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.147711 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.148065 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.148067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.148068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.148273 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.148349 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.148621 (+ 272us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.148740 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":39}
I20260923 14:45:14.149655 7403 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:14.150329 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.150059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:58958)
0923 14:45:14.150207 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.150280 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260923 14:45:14.150943 7351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
I20260923 14:45:14.151870 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.151631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:58968)
0923 14:45:14.151728 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.151822 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 14:45:14.152029 7403 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:36071: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab.
Entry for principal kudu/127.17.4.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab.
I20260923 14:45:14.156116 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:36071
--webserver_interface=127.17.4.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab
--principal=kudu/127.17.4.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:42879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:37355,127.17.4.189:39249,127.17.4.188:36071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:45:14.169220 7328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } attempt: 1
I20260923 14:45:14.170040 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.169747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:58980)
0923 14:45:14.169890 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.169964 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 14:45:14.170747 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.170531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:58992)
0923 14:45:14.170643 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.170695 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 14:45:14.170879 7328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:36071: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
I20260923 14:45:14.201336 7403 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } attempt: 1
I20260923 14:45:14.202240 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.201944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59000)
0923 14:45:14.202096 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.202160 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260923 14:45:14.202966 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.202731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59012)
0923 14:45:14.202837 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.202908 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 14:45:14.203092 7403 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:36071: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
I20260923 14:45:14.246069 7328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } attempt: 2
I20260923 14:45:14.246932 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.246631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59022)
0923 14:45:14.246783 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.246853 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 14:45:14.247624 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.247420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59028)
0923 14:45:14.247526 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.247575 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 14:45:14.247746 7328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:36071: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
W20260923 14:45:14.269490 7410 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 14:45:14.269830 7410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:14.269903 7410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:14.269982 7410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 14:45:14.271260 7403 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } attempt: 2
I20260923 14:45:14.272089 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.271742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59042)
0923 14:45:14.271933 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.272001 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260923 14:45:14.272769 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.272554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59056)
0923 14:45:14.272666 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.272712 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 14:45:14.272889 7403 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:36071: Network error: Client connection negotiation failed: client connection to 127.17.4.188:36071: connect: Connection refused (error 111)
W20260923 14:45:14.274492 7410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:14.274567 7410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:14.274609 7410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:14.274667 7410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:14.274706 7410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:14.279939 7410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:42879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:37355,127.17.4.189:39249,127.17.4.188:36071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab
--principal=kudu/127.17.4.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:36071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.4.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:14.280977 7410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:14.282049 7410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:14.290294 7415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:14.290310 7418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:14.290318 7416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:14.290647 7410 server_base.cc:1034] running on GCE node
I20260923 14:45:14.291193 7410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:14.292366 7410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:14.293509 7410 hybrid_clock.cc:648] HybridClock initialized: now 1790174714293495 us; error 26 us; skew 500 ppm
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:14.296209 7410 init.cc:377] Logged in from keytab as kudu/127.17.4.188@KRBTEST.COM (short username kudu)
I20260923 14:45:14.297057 7410 webserver.cc:460] Webserver started at http://127.17.4.188:39543/ using document root <none> and password file <none>
I20260923 14:45:14.297550 7410 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:14.297606 7410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:14.297761 7410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:14.299652 7410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data/instance:
uuid: "72fef1f1af054b9899b2b4045e17b23f"
format_stamp: "Formatted at 2026-09-23 14:45:14 on dist-test-slave-54kg"
server_key: "1618fcbd82731e1dc1e554f8c6cc44c6"
server_key_iv: "450ae596579cb4d7b86ecf45f9e1fa32"
server_key_version: "encryptionkey@0"
I20260923 14:45:14.300217 7410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal/instance:
uuid: "72fef1f1af054b9899b2b4045e17b23f"
format_stamp: "Formatted at 2026-09-23 14:45:14 on dist-test-slave-54kg"
server_key: "1618fcbd82731e1dc1e554f8c6cc44c6"
server_key_iv: "450ae596579cb4d7b86ecf45f9e1fa32"
server_key_version: "encryptionkey@0"
I20260923 14:45:14.303751 7410 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 14:45:14.306105 7425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:14.307291 7410 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 14:45:14.307427 7410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal
uuid: "72fef1f1af054b9899b2b4045e17b23f"
format_stamp: "Formatted at 2026-09-23 14:45:14 on dist-test-slave-54kg"
server_key: "1618fcbd82731e1dc1e554f8c6cc44c6"
server_key_iv: "450ae596579cb4d7b86ecf45f9e1fa32"
server_key_version: "encryptionkey@0"
I20260923 14:45:14.307538 7410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:14.333642 7410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:14.336557 7410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:14.336766 7410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:14.343815 7410 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.188:36071
I20260923 14:45:14.344126 7477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.188:36071 every 8 connection(s)
I20260923 14:45:14.344816 7410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
I20260923 14:45:14.346946 7328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } attempt: 3
I20260923 14:45:14.347736 7478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:14.351533 7478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:14.352602 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7410
I20260923 14:45:14.352727 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790174436877568-17426-0/minicluster-data/master-2/wal/instance
I20260923 14:45:14.353034 17426 external_mini_cluster.cc:1428] Setting key 3c32d697a8593437ebcf7ed2ece66eec
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:14.359884 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.347453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59066)
0923 14:45:14.347588 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.347605 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.347698 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.349950 (+ 2252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.349953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.350165 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.350275 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.350283 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.351575 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.351581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.352234 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.352243 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.353080 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.353084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.353163 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.353704 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.353718 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.355281 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.357895 (+ 2614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.357898 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.357901 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.358092 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.358436 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.358440 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.358443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.358524 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.359236 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.359240 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.359351 (+ 111us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.359485 (+ 134us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.359634 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:45:14.360983 7480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.348207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59066 (local address 127.17.4.188:36071)
0923 14:45:14.348646 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.348661 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.348697 (+ 36us) server_negotiation.cc:407] Connection header received
0923 14:45:14.349341 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.349356 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.349674 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.350003 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.350428 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.351420 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.352364 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.352953 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.353125 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.355443 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.355447 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.355456 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.355480 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.357598 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.358207 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.358213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.358218 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.358339 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.358621 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.358626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.358628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.359130 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.359263 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.359633 (+ 370us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.359948 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":146,"threads_started":1}
I20260923 14:45:14.363736 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.353416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37246 (local address 127.17.4.190:37355)
0923 14:45:14.353564 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.353570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.353951 (+ 381us) server_negotiation.cc:407] Connection header received
0923 14:45:14.354138 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.354144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.354198 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.354273 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.355206 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.356013 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.357044 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.357265 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.357378 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.359798 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.359802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.359805 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.359829 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.361467 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.362241 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.362246 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.362251 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.362348 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.362642 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.362646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.362648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.362945 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.363067 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.363489 (+ 422us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.363602 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:45:14.364024 7403 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } attempt: 3
I20260923 14:45:14.365589 7483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.354244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59072 (local address 127.17.4.188:36071)
0923 14:45:14.354536 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.354543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.354559 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:45:14.354613 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.354616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.354651 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.354752 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.355646 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.356466 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.358016 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.358358 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.358461 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.361360 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.361363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.361365 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.361390 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.363829 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.364371 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.364374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.364376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.364457 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.364776 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.364780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.364781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.364980 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.365156 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.365283 (+ 127us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.365422 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":93,"threads_started":1}
I20260923 14:45:14.366070 7328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844: Bootstrap starting.
I20260923 14:45:14.368683 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.353431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:37355 (local address 127.0.0.1:37246)
0923 14:45:14.353827 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.353880 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.354032 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.354465 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.354471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.354915 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.355077 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.355085 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.356148 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.356150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.356904 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.356914 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.357386 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.357389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.357504 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.358045 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.358059 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.359621 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.361577 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.361588 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.361594 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.362106 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.362458 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.362461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.362463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.362556 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.363065 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.363072 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.363247 (+ 175us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.363412 (+ 165us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.368501 (+ 5089us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":117,"threads_started":1}
I20260923 14:45:14.369143 7328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:14.370128 7478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:14.370185 7328 log.cc:824] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844: Log is configured to *not* fsync() on all Append() calls
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:14.372754 7328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844: No bootstrap required, opened a new log
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:14.377640 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.366653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.17.4.190:37355)
0923 14:45:14.366759 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.366761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.366772 (+ 11us) server_negotiation.cc:407] Connection header received
0923 14:45:14.366871 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.366873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.366904 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.366964 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.367707 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.368431 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.369510 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.369820 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.369891 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.373978 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.373984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.373990 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.374019 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.375559 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.376189 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.376193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.376196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.376280 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.376606 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.376609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.376611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.376829 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.376989 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.377371 (+ 382us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.377497 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 14:45:14.377466 7328 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.377874 7328 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccdb5c03fc934549b10faf89b1dd5844, State: Initialized, Role: FOLLOWER
I20260923 14:45:14.378258 7328 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.378532 7480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.364475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59080 (local address 127.17.4.188:36071)
0923 14:45:14.364650 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.364654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.368069 (+ 3415us) server_negotiation.cc:407] Connection header received
0923 14:45:14.368167 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.368169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.368210 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.368761 (+ 551us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.368842 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.369630 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.371097 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.371429 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.372693 (+ 1264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.373631 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.373635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.373637 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.373662 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.376602 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.377075 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.377078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.377080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.377153 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.377488 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.377491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.377493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.377673 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.378193 (+ 520us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.378268 (+ 75us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.378380 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260923 14:45:14.379192 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.364449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59080)
0923 14:45:14.367980 (+ 3531us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.367995 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.368093 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.368350 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.368354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.368545 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.368650 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.368657 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.369777 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.369780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.370948 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.370962 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.371565 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.371570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.371664 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.372158 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.372173 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.373502 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.376714 (+ 3212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.376718 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.376720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.376959 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.377261 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.377267 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.377271 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.377361 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.377799 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.377804 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.377914 (+ 110us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.378000 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.379043 (+ 1043us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3442}
I20260923 14:45:14.379730 7328 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:14.380290 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.370596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:39249 (local address 127.0.0.1:38142)
0923 14:45:14.370671 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.370685 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.370757 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.371213 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.371216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.371406 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.371514 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.371524 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.372582 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.372589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.373253 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.373263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.374129 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.374133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.374261 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.374704 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.374723 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.376415 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.378418 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.378421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.378423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.378673 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.378934 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.378938 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.378940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.379026 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.379746 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.379749 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.379882 (+ 133us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.380006 (+ 124us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.380133 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260923 14:45:14.380970 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.370838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38142 (local address 127.17.4.189:39249)
0923 14:45:14.370948 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.370952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.370966 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:45:14.370997 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.371003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.371052 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.371121 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.371625 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.372448 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.373387 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.373665 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.373770 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.376572 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.376577 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.376580 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.376606 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.378294 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.378760 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.378763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.378765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.378848 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.379133 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.379138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.379139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.379613 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.379702 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.380665 (+ 963us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.380773 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 14:45:14.382411 7403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: Bootstrap starting.
I20260923 14:45:14.382773 7485 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.382923 7485 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.384968 7478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } has no permanent_uuid. Determining permanent_uuid...
W20260923 14:45:14.385133 7497 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:45:14.385241 7497 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:14.387459 7403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:14.388367 7403 log.cc:824] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:14.385278 7260 master_runner.cc:186] Error getting master registration for 127.17.4.189:39249: OK, instance_id { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" instance_seqno: 1790174714115243 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 14:45:14.389484 7260 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 23 14:45:14 dist-test-slave-54kg krb5kdc[7247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:45:14.391036 7486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.379731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38144 (local address 127.17.4.189:39249)
0923 14:45:14.380362 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.380377 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.380404 (+ 27us) server_negotiation.cc:407] Connection header received
0923 14:45:14.380446 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.380450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.380499 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.381351 (+ 852us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.381454 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.382181 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.383351 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.383707 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.384143 (+ 436us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.386658 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.386662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.386665 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.386688 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.388495 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.388963 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.388966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.388968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.389052 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.389659 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.389662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.389663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.389870 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.390653 (+ 783us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.390733 (+ 80us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.390855 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":119,"threads_started":1}
I20260923 14:45:14.391484 7403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: No bootstrap required, opened a new log
I20260923 14:45:14.394170 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.385409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:36071 (local address 127.0.0.1:59094)
0923 14:45:14.385521 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:14.385536 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:14.385613 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:14.385864 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:14.385867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:14.386033 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:14.386139 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.386149 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.387188 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.387192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.388089 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:14.388099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.388996 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.389000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:14.389095 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.389568 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:14.389585 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:14.390943 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:14.392795 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.392798 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.392800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.393004 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.393259 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:14.393261 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:14.393263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:14.393331 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:14.393714 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:14.393717 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:14.393795 (+ 78us) client_negotiation.cc:769] Sending connection context
0923 14:45:14.393888 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 14:45:14.394008 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260923 14:45:14.394569 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:14.394670 7480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.385590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59094 (local address 127.17.4.188:36071)
0923 14:45:14.385677 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.385681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.385693 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:45:14.385726 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.385731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.385769 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.385844 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.386329 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.387045 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.388516 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.388856 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.388980 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.391090 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.391093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.391095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.391120 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.392686 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.393111 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.393113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.393116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.393182 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.393413 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.393416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.393420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.393595 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.393681 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.394395 (+ 714us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.394495 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 14:45:14.395779 7403 raft_consensus.cc:348] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.396095 7403 raft_consensus.cc:729] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65c9eb0d3784f4497a91c1e3981f89d, State: Initialized, Role: FOLLOWER
I20260923 14:45:14.396117 7302 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ccdb5c03fc934549b10faf89b1dd5844"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37252
I20260923 14:45:14.396346 7302 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 14:45:14.396474 7302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:14.396479 7403 consensus_queue.cc:260] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.396965 7500 sys_catalog.cc:455] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.397153 7500 sys_catalog.cc:458] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.397748 7403 sys_catalog.cc:564] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:14.397747 7302 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.398697 7302 leader_election.cc:288] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [CANDIDATE]: Term 1 election: Requested vote from peers b65c9eb0d3784f4497a91c1e3981f89d (127.17.4.189:39249), 72fef1f1af054b9899b2b4045e17b23f (127.17.4.188:36071)
I20260923 14:45:14.399451 7377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ccdb5c03fc934549b10faf89b1dd5844" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b65c9eb0d3784f4497a91c1e3981f89d"
I20260923 14:45:14.399708 7377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:14.401237 7377 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccdb5c03fc934549b10faf89b1dd5844 in term 1.
I20260923 14:45:14.401656 7277 leader_election.cc:302] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b65c9eb0d3784f4497a91c1e3981f89d, ccdb5c03fc934549b10faf89b1dd5844; no voters:
I20260923 14:45:14.401947 7485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:14.402175 7485 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [term 1 LEADER]: Becoming Leader. State: Replica: ccdb5c03fc934549b10faf89b1dd5844, State: Running, Role: LEADER
I20260923 14:45:14.402522 7485 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.404738 7485 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccdb5c03fc934549b10faf89b1dd5844. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.404842 7485 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:14.406555 7478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: Bootstrap starting.
I20260923 14:45:14.406865 7517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:14.409381 7478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:14.409853 7517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:14.410403 7478 log.cc:824] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: Log is configured to *not* fsync() on all Append() calls
W20260923 14:45:14.412262 7511 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:45:14.412410 7511 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:45:14.409788 7335 master_runner.cc:186] Error getting master registration for 127.17.4.188:36071: OK, instance_id { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" instance_seqno: 1790174714341737 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 14:45:14.413194 7335 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 14:45:14.414292 7478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: No bootstrap required, opened a new log
I20260923 14:45:14.416088 7377 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [term 1 FOLLOWER]: Refusing update from remote peer ccdb5c03fc934549b10faf89b1dd5844: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:45:14.416743 7512 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:45:14.418541 7478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.418763 7478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72fef1f1af054b9899b2b4045e17b23f, State: Initialized, Role: FOLLOWER
I20260923 14:45:14.419082 7478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } }
I20260923 14:45:14.419567 7522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.419692 7522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.420509 7478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:14.420677 7500 sys_catalog.cc:455] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccdb5c03fc934549b10faf89b1dd5844. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.420794 7500 sys_catalog.cc:458] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.421383 7451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:14.422816 7451 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [term 1 FOLLOWER]: Refusing update from remote peer ccdb5c03fc934549b10faf89b1dd5844: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:45:14.423174 7452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ccdb5c03fc934549b10faf89b1dd5844" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "72fef1f1af054b9899b2b4045e17b23f"
I20260923 14:45:14.423552 7512 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:45:14.424744 7452 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccdb5c03fc934549b10faf89b1dd5844 in term 1.
I20260923 14:45:14.429419 7522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccdb5c03fc934549b10faf89b1dd5844. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.429535 7522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.436383 7480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.422933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59100 (local address 127.17.4.188:36071)
0923 14:45:14.423060 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.423068 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.426427 (+ 3359us) server_negotiation.cc:407] Connection header received
0923 14:45:14.426648 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.426651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.426702 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.426755 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.427847 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.428622 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.429931 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.430251 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.430331 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.432448 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.432453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.432458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.432486 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.434377 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.434935 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.434939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.434941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.435025 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.435334 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.435337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.435339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.435563 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.435669 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.436096 (+ 427us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.436213 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 14:45:14.437628 7512 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.437763 7512 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:14.437883 7521 mvcc.cc:205] Tried to move back new op lower bound from 7332555630239653888 to 7332555630196277248. Current Snapshot: MvccSnapshot[applied={T|T < 7332555630239653888}]
I20260923 14:45:14.439486 7517 catalog_manager.cc:1347] Generated new cluster ID: ca04b6d64630436d805b322cc83f0446
I20260923 14:45:14.439550 7517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:14.439916 7522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.440026 7522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.440896 7539 mvcc.cc:205] Tried to move back new op lower bound from 7332555630239653888 to 7332555630196277248. Current Snapshot: MvccSnapshot[applied={T|T < 7332555630239653888}]
I20260923 14:45:14.441277 7485 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.441388 7485 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:14.442492 7500 sys_catalog.cc:455] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ccdb5c03fc934549b10faf89b1dd5844" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccdb5c03fc934549b10faf89b1dd5844" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 37355 } } peers { permanent_uuid: "b65c9eb0d3784f4497a91c1e3981f89d" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 39249 } } peers { permanent_uuid: "72fef1f1af054b9899b2b4045e17b23f" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 36071 } } }
I20260923 14:45:14.442616 7500 sys_catalog.cc:458] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:14.443104 7523 mvcc.cc:205] Tried to move back new op lower bound from 7332555630239653888 to 7332555630196277248. Current Snapshot: MvccSnapshot[applied={T|T < 7332555630239653888}]
W20260923 14:45:14.443842 7535 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:45:14.443975 7535 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:45:14.449708 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.426567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37266 (local address 127.17.4.190:37355)
0923 14:45:14.426677 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.426681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.436054 (+ 9373us) server_negotiation.cc:407] Connection header received
0923 14:45:14.436148 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.436151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.436207 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.436286 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.438792 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.439481 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.443498 (+ 4017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.443838 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.443935 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.446059 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.446064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.446067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.446094 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.447795 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.448299 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.448305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.448307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.448390 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.448702 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.448706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.448708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.448922 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.449055 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.449413 (+ 358us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.449530 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:45:14.451877 7486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:14.426117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38150 (local address 127.17.4.189:39249)
0923 14:45:14.426233 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.426238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.431624 (+ 5386us) server_negotiation.cc:407] Connection header received
0923 14:45:14.431805 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.431808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.431858 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.431910 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.433937 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.434738 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.445837 (+ 11099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:14.446175 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:14.446280 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:14.448114 (+ 1834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:14.448117 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:14.448120 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:14.448146 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:14.449821 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.450271 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.450275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.450276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.450354 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:14.450648 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:14.450651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:14.450653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:14.450867 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:14.451015 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:14.451582 (+ 567us) server_negotiation.cc:299] Negotiation successful
0923 14:45:14.451699 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260923 14:45:14.467559 7517 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:14.468834 7517 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:14.494196 7517 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ccdb5c03fc934549b10faf89b1dd5844: Generated new TSK 0
I20260923 14:45:14.495093 7517 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 14:45:14.527263 7330 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.524684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37278 (local address 127.17.4.190:37355)
0923 14:45:14.524828 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.524833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.526176 (+ 1343us) server_negotiation.cc:407] Connection header received
0923 14:45:14.526384 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.526388 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.526452 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.526506 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.527130 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37278: BlockingRecv error: recv got EOF from 127.0.0.1:37278 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 14:45:14.528717 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.525568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38156 (local address 127.17.4.189:39249)
0923 14:45:14.525682 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.525686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.527745 (+ 2059us) server_negotiation.cc:407] Connection header received
0923 14:45:14.527951 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.527955 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.528006 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.528056 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.528584 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38156: BlockingRecv error: recv got EOF from 127.0.0.1:38156 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260923 14:45:14.530586 7480 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.529343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.17.4.188:36071)
0923 14:45:14.529462 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.529466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.529737 (+ 271us) server_negotiation.cc:407] Connection header received
0923 14:45:14.529889 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.529892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.529940 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.529989 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.530461 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59108: BlockingRecv error: recv got EOF from 127.0.0.1:59108 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260923 14:45:14.534988 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.533509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38168 (local address 127.17.4.189:39249)
0923 14:45:14.533611 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.533615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.534023 (+ 408us) server_negotiation.cc:407] Connection header received
0923 14:45:14.534254 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.534257 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.534333 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.534385 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.534886 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38168: BlockingRecv error: recv got EOF from 127.0.0.1:38168 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260923 14:45:14.542788 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.538589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38172 (local address 127.17.4.189:39249)
0923 14:45:14.538687 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.538691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.539190 (+ 499us) server_negotiation.cc:407] Connection header received
0923 14:45:14.539393 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.539397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.539462 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.539517 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.542683 (+ 3166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38172: BlockingRecv error: recv got EOF from 127.0.0.1:38172 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260923 14:45:14.548393 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.546900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38188 (local address 127.17.4.189:39249)
0923 14:45:14.547005 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.547009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.547474 (+ 465us) server_negotiation.cc:407] Connection header received
0923 14:45:14.547655 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.547658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.547702 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.547751 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.548287 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38188: BlockingRecv error: recv got EOF from 127.0.0.1:38188 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260923 14:45:14.556030 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.554498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38204 (local address 127.17.4.189:39249)
0923 14:45:14.554627 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.554631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.555097 (+ 466us) server_negotiation.cc:407] Connection header received
0923 14:45:14.555276 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.555279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.555323 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.555373 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.555927 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38204: BlockingRecv error: recv got EOF from 127.0.0.1:38204 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260923 14:45:14.567960 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.566335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38216 (local address 127.17.4.189:39249)
0923 14:45:14.566454 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.566458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.566960 (+ 502us) server_negotiation.cc:407] Connection header received
0923 14:45:14.567156 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.567159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.567207 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.567259 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.567846 (+ 587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38216: BlockingRecv error: recv got EOF from 127.0.0.1:38216 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260923 14:45:14.588363 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.586511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38222 (local address 127.17.4.189:39249)
0923 14:45:14.586630 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.586635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.587237 (+ 602us) server_negotiation.cc:407] Connection header received
0923 14:45:14.587487 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.587491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.587552 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.587613 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.588244 (+ 631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38222: BlockingRecv error: recv got EOF from 127.0.0.1:38222 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260923 14:45:14.624624 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.623311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38230 (local address 127.17.4.189:39249)
0923 14:45:14.623492 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.623496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.623638 (+ 142us) server_negotiation.cc:407] Connection header received
0923 14:45:14.623795 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.623799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.623861 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.623978 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.624503 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38230: BlockingRecv error: recv got EOF from 127.0.0.1:38230 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260923 14:45:14.692046 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.690820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38244 (local address 127.17.4.189:39249)
0923 14:45:14.690984 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.690989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.691158 (+ 169us) server_negotiation.cc:407] Connection header received
0923 14:45:14.691334 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.691337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.691391 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.691486 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.691940 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38244: BlockingRecv error: recv got EOF from 127.0.0.1:38244 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 14:45:14.823390 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:14.822355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38252 (local address 127.17.4.189:39249)
0923 14:45:14.822508 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:14.822512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:14.822647 (+ 135us) server_negotiation.cc:407] Connection header received
0923 14:45:14.822766 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:14.822768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:14.822813 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:14.822887 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:14.823254 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38252: BlockingRecv error: recv got EOF from 127.0.0.1:38252 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260923 14:45:15.082883 7486 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:15.081611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38256 (local address 127.17.4.189:39249)
0923 14:45:15.081754 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:15.081760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:15.081853 (+ 93us) server_negotiation.cc:407] Connection header received
0923 14:45:15.082129 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:15.082132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:15.082189 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:15.082282 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:15.082774 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38256: BlockingRecv error: recv got EOF from 127.0.0.1:38256 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 14:45:15.413686 7511 catalog_manager.cc:1259] Loaded cluster ID: ca04b6d64630436d805b322cc83f0446
I20260923 14:45:15.413772 7511 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: loading cluster ID for follower catalog manager: success
I20260923 14:45:15.415352 7511 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: acquiring CA information for follower catalog manager: success
I20260923 14:45:15.416513 7511 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b65c9eb0d3784f4497a91c1e3981f89d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 14:45:15.445201 7535 catalog_manager.cc:1259] Loaded cluster ID: ca04b6d64630436d805b322cc83f0446
I20260923 14:45:15.445292 7535 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: loading cluster ID for follower catalog manager: success
I20260923 14:45:15.446979 7535 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: acquiring CA information for follower catalog manager: success
I20260923 14:45:15.448148 7535 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72fef1f1af054b9899b2b4045e17b23f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 14:45:15.601125 7608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:15.597212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38268 (local address 127.17.4.189:39249)
0923 14:45:15.597473 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:15.597478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:15.597495 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:45:15.597645 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:15.597648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:15.597775 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:15.597872 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:15.598124 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.598780 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.599667 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.599945 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.600022 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:15.600301 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:15.600734 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:15.600822 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:15.600883 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 14:45:15.600929 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":81,"threads_started":1}
I20260923 14:45:15.607522 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:15.604169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.17.4.188:36071)
0923 14:45:15.604399 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:15.604403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:15.604415 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:45:15.604495 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:15.604497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:15.604601 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:15.604694 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:15.604865 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.605347 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.606123 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.606387 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.606489 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:15.606751 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:15.607142 (+ 391us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:15.607229 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:15.607279 (+ 50us) server_negotiation.cc:299] Negotiation successful
0923 14:45:15.607323 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":92,"threads_started":1}
I20260923 14:45:15.614154 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:15.610424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59120 (local address 127.17.4.188:36071)
0923 14:45:15.610542 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:15.610546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:15.610693 (+ 147us) server_negotiation.cc:407] Connection header received
0923 14:45:15.610828 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:15.610831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:15.610877 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:15.610959 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:15.611208 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.612020 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.613037 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.613353 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.613456 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:15.613689 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:15.613767 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:15.613829 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:15.613959 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 14:45:15.614010 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 14:45:15.614323 7608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:15.610424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38280 (local address 127.17.4.189:39249)
0923 14:45:15.610554 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:15.610558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:15.610752 (+ 194us) server_negotiation.cc:407] Connection header received
0923 14:45:15.610863 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:15.610867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:15.610924 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:15.610999 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:15.611351 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.612115 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.613150 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.613481 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.613570 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:15.613823 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:15.613899 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:15.613946 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:15.614116 (+ 170us) server_negotiation.cc:299] Negotiation successful
0923 14:45:15.614167 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 14:45:15.615236 7621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:15.610147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37292 (local address 127.17.4.190:37355)
0923 14:45:15.610410 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:15.610415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:15.611022 (+ 607us) server_negotiation.cc:407] Connection header received
0923 14:45:15.611235 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:15.611238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:15.611390 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:15.611527 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:15.611723 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.612492 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.613498 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:15.613813 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:15.613884 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:15.614500 (+ 616us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:15.614814 (+ 314us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:15.614865 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:15.615067 (+ 202us) server_negotiation.cc:299] Negotiation successful
0923 14:45:15.615116 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":69,"threads_started":1}
I20260923 14:45:15.624024 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7260
I20260923 14:45:15.630455 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7335
I20260923 14:45:15.636021 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7410
2026-09-23T14:45:15Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3093 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 14:45:15 dist-test-slave-54kg krb5kdc[7625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 14:45:15 dist-test-slave-54kg krb5kdc[7625](info): set up 2 sockets
Sep 23 14:45:15 dist-test-slave-54kg krb5kdc[7625](info): commencing operation
krb5kdc: starting...
W20260923 14:45:16.761358 17426 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/test-user.keytab.
Sep 23 14:45:16 dist-test-slave-54kg krb5kdc[7625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T14:45:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T14:45:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.4.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
Entry for principal kudu/127.17.4.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab.
I20260923 14:45:16.880122 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46477
--webserver_interface=127.17.4.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46477,127.17.4.189:38129,127.17.4.188:35599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 14:45:16.987385 7638 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 14:45:16.987655 7638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:16.987679 7638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:16.987807 7638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:16.991600 7638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:16.991680 7638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:16.991699 7638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:16.991751 7638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:16.991811 7638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:16.997249 7638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46477,127.17.4.189:38129,127.17.4.188:35599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.190.keytab
--principal=kudu/127.17.4.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.190:46477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.4.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:16.998275 7638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:16.999254 7638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:17.007516 7644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:17.007606 7638 server_base.cc:1034] running on GCE node
W20260923 14:45:17.007529 7646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:17.007529 7643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:17.008388 7638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:17.009583 7638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:17.010742 7638 hybrid_clock.cc:648] HybridClock initialized: now 1790174717010711 us; error 44 us; skew 500 ppm
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:17.013481 7638 init.cc:377] Logged in from keytab as kudu/127.17.4.190@KRBTEST.COM (short username kudu)
I20260923 14:45:17.014344 7638 webserver.cc:460] Webserver started at http://127.17.4.190:42961/ using document root <none> and password file <none>
I20260923 14:45:17.014925 7638 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:17.015012 7638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:17.015269 7638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:17.017361 7638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data/instance:
uuid: "c5fae3c70ccd4700ad5fc286325384a7"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "baa3ad8c39507b9936e4aa3a7beb5fc7"
server_key_iv: "c8643ce8bb72151a8896b03b5ed1e86f"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.017916 7638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal/instance:
uuid: "c5fae3c70ccd4700ad5fc286325384a7"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "baa3ad8c39507b9936e4aa3a7beb5fc7"
server_key_iv: "c8643ce8bb72151a8896b03b5ed1e86f"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.021613 7638 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:45:17.023953 7653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:17.025085 7638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 14:45:17.025220 7638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal
uuid: "c5fae3c70ccd4700ad5fc286325384a7"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "baa3ad8c39507b9936e4aa3a7beb5fc7"
server_key_iv: "c8643ce8bb72151a8896b03b5ed1e86f"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.025326 7638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:17.038364 7638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:17.041584 7638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:17.041779 7638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:17.048548 7638 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.190:46477
I20260923 14:45:17.048861 7705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.190:46477 every 8 connection(s)
I20260923 14:45:17.049484 7638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/data/info.pb
I20260923 14:45:17.052263 7706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:17.055619 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7638
I20260923 14:45:17.055759 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-0/wal/instance
I20260923 14:45:17.056107 17426 external_mini_cluster.cc:1428] Setting key 908987a6137a51b31cce801051c175ed
I20260923 14:45:17.055917 7706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.4.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.189@KRBTEST.COM" created.
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:17.073215 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.058066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46477 (local address 127.0.0.1:45606)
0923 14:45:17.058517 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.058566 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.059446 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.060264 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.060268 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.060578 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.060843 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.060854 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.062663 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.062666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.063360 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.063368 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.064281 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.064288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.064413 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.064920 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.064935 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.068103 (+ 3168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.070421 (+ 2318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.070430 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.070436 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.070644 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.071086 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.071088 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.071089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.071192 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.071977 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.071982 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.072098 (+ 116us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.072234 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.072470 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":2,"spinlock_wait_cycles":7936,"thread_start_us":132,"threads_started":1}
I20260923 14:45:17.073217 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.058066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45606 (local address 127.17.4.190:46477)
0923 14:45:17.058636 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.058648 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.058692 (+ 44us) server_negotiation.cc:407] Connection header received
0923 14:45:17.059749 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.059757 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.060041 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.060242 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.061020 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.062538 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.063482 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.064114 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.064295 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.068248 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.068253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.068262 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.068283 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.070309 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.070823 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.070832 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.070836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.070982 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.071289 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.071293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.071295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.071841 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.071993 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.072353 (+ 360us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.072563 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":436,"spinlock_wait_cycles":14208,"thread_start_us":146,"threads_started":1}
I20260923 14:45:17.075600 7706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:17.076349 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.076124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45394)
0923 14:45:17.076233 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.076297 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 14:45:17.076553 7657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
I20260923 14:45:17.077438 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.077207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45406)
0923 14:45:17.077338 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.077389 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 14:45:17.077587 7706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:38129: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab.
Entry for principal kudu/127.17.4.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab.
I20260923 14:45:17.083297 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:38129
--webserver_interface=127.17.4.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab
--principal=kudu/127.17.4.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46477,127.17.4.189:38129,127.17.4.188:35599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:45:17.126850 7706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } attempt: 1
I20260923 14:45:17.127743 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.127410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45418)
0923 14:45:17.127580 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.127652 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260923 14:45:17.128495 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.128281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45428)
0923 14:45:17.128382 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.128434 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 14:45:17.128643 7706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:38129: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
W20260923 14:45:17.192693 7713 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 14:45:17.193082 7713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:17.193125 7713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:17.193189 7713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 14:45:17.196820 7706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } attempt: 2
W20260923 14:45:17.197194 7713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:17.197258 7713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:17.197292 7713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:17.197346 7713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:17.197381 7713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:17.197685 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.197360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45430)
0923 14:45:17.197515 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.197601 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 14:45:17.198387 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.198152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45434)
0923 14:45:17.198261 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.198314 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 14:45:17.198518 7706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.189:38129: Network error: Client connection negotiation failed: client connection to 127.17.4.189:38129: connect: Connection refused (error 111)
I20260923 14:45:17.202798 7713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46477,127.17.4.189:38129,127.17.4.188:35599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.189.keytab
--principal=kudu/127.17.4.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.189:38129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.4.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:17.203682 7713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:17.204667 7713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 14:45:17.212741 7719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:17.212741 7721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:17.212759 7718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:17.213138 7713 server_base.cc:1034] running on GCE node
I20260923 14:45:17.213689 7713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:17.214725 7713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:17.215905 7713 hybrid_clock.cc:648] HybridClock initialized: now 1790174717215888 us; error 34 us; skew 500 ppm
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:17.218581 7713 init.cc:377] Logged in from keytab as kudu/127.17.4.189@KRBTEST.COM (short username kudu)
I20260923 14:45:17.219370 7713 webserver.cc:460] Webserver started at http://127.17.4.189:43457/ using document root <none> and password file <none>
I20260923 14:45:17.219969 7713 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:17.220060 7713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:17.220281 7713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:17.222246 7713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data/instance:
uuid: "0f990ca5d36742f5b468385a76e8686f"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "6d2405fd980070ac9b8cc0845150f110"
server_key_iv: "97c7040a2483d886d2524cdf5d9cd6c7"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.222801 7713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal/instance:
uuid: "0f990ca5d36742f5b468385a76e8686f"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "6d2405fd980070ac9b8cc0845150f110"
server_key_iv: "97c7040a2483d886d2524cdf5d9cd6c7"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.226362 7713 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 14:45:17.228781 7728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:17.230028 7713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:45:17.230166 7713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal
uuid: "0f990ca5d36742f5b468385a76e8686f"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "6d2405fd980070ac9b8cc0845150f110"
server_key_iv: "97c7040a2483d886d2524cdf5d9cd6c7"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.230279 7713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:17.245184 7713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:17.248633 7713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:17.248832 7713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:17.255537 7713 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.189:38129
I20260923 14:45:17.255857 7780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.189:38129 every 8 connection(s)
I20260923 14:45:17.256593 7713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/data/info.pb
I20260923 14:45:17.258550 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7713
I20260923 14:45:17.258683 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-1/wal/instance
I20260923 14:45:17.258942 17426 external_mini_cluster.cc:1428] Setting key 470e2fd7b22a5a86b1a6eaae7b7adb3a
I20260923 14:45:17.259397 7781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:17.263530 7781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.4.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.4.188@KRBTEST.COM" created.
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:17.277949 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.265542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45622 (local address 127.17.4.190:46477)
0923 14:45:17.265687 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.265691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.266676 (+ 985us) server_negotiation.cc:407] Connection header received
0923 14:45:17.267668 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.267671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.267735 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.267850 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.269064 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.269670 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.270826 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.271239 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.271361 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.274115 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.274118 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.274121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.274143 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.275582 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.276154 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.276158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.276160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.276242 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.276594 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.276599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.276601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.276784 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.276895 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.277556 (+ 661us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.277713 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 14:45:17.278769 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.266001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46477 (local address 127.0.0.1:45622)
0923 14:45:17.266522 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.266564 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.267457 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.268042 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.268049 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.268376 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.268886 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.268930 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.269808 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.269811 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.270694 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.270704 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.271402 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.271405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.271552 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.272160 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.272176 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.273944 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.275703 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.275709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.275722 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.276045 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.276346 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.276349 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.276351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.276497 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.276894 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.276900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.277214 (+ 314us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.277450 (+ 236us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.277797 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":168,"threads_started":1}
I20260923 14:45:17.280273 7781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.4.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab.
Entry for principal kudu/127.17.4.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab.
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:17.286535 17426 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
/tmp/dist-test-taskUR6fzw/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:35599
--webserver_interface=127.17.4.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab
--principal=kudu/127.17.4.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.4.148:36841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.4.190:46477,127.17.4.189:38129,127.17.4.188:35599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 14:45:17.289669 7706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } attempt: 3
I20260923 14:45:17.290123 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.280753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45436)
0923 14:45:17.280878 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.280889 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.280950 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.281512 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.281515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.281678 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.281762 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.281767 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.282830 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.282833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.283402 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.283410 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.284097 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.284100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.284169 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.284645 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.284656 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.285936 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.288261 (+ 2325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.288267 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.288269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.288555 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.288838 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.288843 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.288846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.288950 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.289374 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.289380 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.289506 (+ 126us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.289642 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.289862 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 14:45:17.290146 7786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.280877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45436 (local address 127.17.4.189:38129)
0923 14:45:17.281193 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.281201 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.281218 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:45:17.281248 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.281252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.281388 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.281486 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.281862 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.282727 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.283510 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.283992 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.284081 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.286090 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.286100 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.286113 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.286137 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.288152 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.288673 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.288677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.288678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.288749 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.289049 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.289051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.289052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.289268 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.289366 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.289730 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.289937 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":238,"thread_start_us":130,"threads_started":1}
I20260923 14:45:17.292141 7781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:17.292797 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.292565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53710)
0923 14:45:17.292666 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.292735 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260923 14:45:17.292994 7732 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
I20260923 14:45:17.293783 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.293577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53716)
0923 14:45:17.293675 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.293720 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 14:45:17.293962 7781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35599: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:17.300715 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.290068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45440)
0923 14:45:17.290255 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.290267 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.290329 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.291486 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.291491 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.291698 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.291867 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.291878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.293054 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.293061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.294625 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.294639 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.295380 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.295384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.295469 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.296001 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.296013 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.297443 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.299302 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.299304 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.299306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.299490 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.299758 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.299760 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.299810 (+ 50us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.299892 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.300275 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.300277 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.300355 (+ 78us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.300428 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.300538 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260923 14:45:17.300778 7786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.290528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45440 (local address 127.17.4.189:38129)
0923 14:45:17.291246 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.291252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.291266 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:45:17.291297 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.291300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.291337 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.291417 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.292019 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.292879 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.294795 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.295234 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.295362 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.297588 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.297594 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.297598 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.297632 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.299191 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.299586 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.299590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.299592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.299672 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.299977 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.299981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.299982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.300185 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.300280 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.300517 (+ 237us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.300626 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":628,"server-negotiator.queue_time_us":662}
I20260923 14:45:17.301775 7706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:17.302455 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.302183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53730)
0923 14:45:17.302305 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.302359 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 14:45:17.303088 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.302845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53740)
0923 14:45:17.302987 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.303034 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260923 14:45:17.303210 7706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35599: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
I20260923 14:45:17.334362 7706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } attempt: 1
I20260923 14:45:17.335147 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.334840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53742)
0923 14:45:17.334995 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.335061 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260923 14:45:17.335868 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.335618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53750)
0923 14:45:17.335719 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.335795 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 14:45:17.336031 7706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35599: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
I20260923 14:45:17.343205 7781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } attempt: 1
I20260923 14:45:17.343930 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.343640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53766)
0923 14:45:17.343798 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.343865 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 14:45:17.344625 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.344440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53774)
0923 14:45:17.344536 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.344576 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260923 14:45:17.344777 7781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35599: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
W20260923 14:45:17.399425 7787 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 14:45:17.399680 7787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 14:45:17.399703 7787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 14:45:17.399739 7787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 14:45:17.403716 7787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 14:45:17.403826 7787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 14:45:17.403873 7787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 14:45:17.403898 7787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 14:45:17.403913 7787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 14:45:17.409008 7787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.4.148:36841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.4.190:46477,127.17.4.189:38129,127.17.4.188:35599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/krb5kdc/kudu_127.17.4.188.keytab
--principal=kudu/127.17.4.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.4.188:35599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.4.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 14:01:48 UTC on ccycloud.quasar-ievbqq.root.comops.site
build id 4667499
I20260923 14:45:17.410000 7787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 14:45:17.411008 7787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 14:45:17.411180 7706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } attempt: 2
I20260923 14:45:17.412091 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.411679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53780)
0923 14:45:17.411886 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.411959 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260923 14:45:17.412972 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.412695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53794)
0923 14:45:17.412826 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.412918 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260923 14:45:17.412953 7781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } attempt: 2
W20260923 14:45:17.413120 7706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35599: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
I20260923 14:45:17.413548 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.413312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53796)
0923 14:45:17.413441 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.413489 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 14:45:17.414187 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.414006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53808)
0923 14:45:17.414100 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.414140 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 14:45:17.414343 7781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.4.188:35599: Network error: Client connection negotiation failed: client connection to 127.17.4.188:35599: connect: Connection refused (error 111)
W20260923 14:45:17.419853 7796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:17.419860 7793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 14:45:17.419859 7794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 14:45:17.419996 7787 server_base.cc:1034] running on GCE node
I20260923 14:45:17.420591 7787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 14:45:17.421603 7787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 14:45:17.422778 7787 hybrid_clock.cc:648] HybridClock initialized: now 1790174717422749 us; error 47 us; skew 500 ppm
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 14:45:17.430334 7787 init.cc:377] Logged in from keytab as kudu/127.17.4.188@KRBTEST.COM (short username kudu)
I20260923 14:45:17.431180 7787 webserver.cc:460] Webserver started at http://127.17.4.188:36723/ using document root <none> and password file <none>
I20260923 14:45:17.431669 7787 fs_manager.cc:359] Metadata directory not provided
I20260923 14:45:17.431725 7787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 14:45:17.431958 7787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 14:45:17.433954 7787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data/instance:
uuid: "9905d42c51d4431aafa68ec3bb46cc13"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "561f6e2dc987bd7becc7f32f453fc7ac"
server_key_iv: "bc0b8603748a910caf1518d39aa115e7"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.434496 7787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal/instance:
uuid: "9905d42c51d4431aafa68ec3bb46cc13"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "561f6e2dc987bd7becc7f32f453fc7ac"
server_key_iv: "bc0b8603748a910caf1518d39aa115e7"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.438024 7787 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 14:45:17.440244 7803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 14:45:17.441396 7787 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 14:45:17.441520 7787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data,/tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal
uuid: "9905d42c51d4431aafa68ec3bb46cc13"
format_stamp: "Formatted at 2026-09-23 14:45:17 on dist-test-slave-54kg"
server_key: "561f6e2dc987bd7becc7f32f453fc7ac"
server_key_iv: "bc0b8603748a910caf1518d39aa115e7"
server_key_version: "encryptionkey@0"
I20260923 14:45:17.441619 7787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 14:45:17.484206 7787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 14:45:17.488045 7787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 14:45:17.488317 7787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 14:45:17.497014 7787 rpc_server.cc:307] RPC server started. Bound to: 127.17.4.188:35599
I20260923 14:45:17.497350 7855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.4.188:35599 every 8 connection(s)
I20260923 14:45:17.498402 7787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/data/info.pb
I20260923 14:45:17.501917 7856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 14:45:17.503690 17426 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu as pid 7787
I20260923 14:45:17.503870 17426 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUR6fzw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790174436877568-17426-0/minicluster-data/master-2/wal/instance
I20260923 14:45:17.504207 17426 external_mini_cluster.cc:1428] Setting key 7c354407e3ad9751c6edd9056f15ed86
I20260923 14:45:17.505537 7781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } attempt: 3
I20260923 14:45:17.506716 7856 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:17.512251 7706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } attempt: 3
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.189@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.190@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:45:17.523880 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.510223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45634 (local address 127.17.4.190:46477)
0923 14:45:17.510342 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.510347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.510523 (+ 176us) server_negotiation.cc:407] Connection header received
0923 14:45:17.510654 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.510657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.510715 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.510794 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.511696 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.512421 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.513785 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.514146 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.514227 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.518372 (+ 4145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.518379 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.518383 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.518412 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.520287 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.521620 (+ 1333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.521626 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.521628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.521742 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.522206 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.522211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.522214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.522569 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.522657 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.523458 (+ 801us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.523607 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":51,"spinlock_wait_cycles":13696}
I20260923 14:45:17.524732 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.506541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53820)
0923 14:45:17.506753 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.506771 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.506873 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.509052 (+ 2179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.509057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.509297 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.509460 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.509470 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.511894 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.511901 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.512901 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.512915 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.513968 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.513974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.514074 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.514838 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.514859 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.516568 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.521506 (+ 4938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.521513 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.521517 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.521790 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.523545 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.523548 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.523550 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.523652 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.524186 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.524189 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.524293 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.524388 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.524549 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127}
I20260923 14:45:17.524922 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.512602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53828)
0923 14:45:17.512842 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.512855 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.512929 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.513564 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.513567 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.513751 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.513901 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.513913 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.514991 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.514995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.515638 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.515652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.516333 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.516337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.516420 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.517812 (+ 1392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.517827 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.519287 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.523157 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.523162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.523164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.523450 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.523962 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.523965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.523967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.524054 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.524459 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.524462 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.524551 (+ 89us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.524638 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.524753 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":3}
I20260923 14:45:17.525771 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.506560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53820 (local address 127.17.4.188:35599)
0923 14:45:17.507130 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.507147 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.507180 (+ 33us) server_negotiation.cc:407] Connection header received
0923 14:45:17.508306 (+ 1126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.508333 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.508762 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.509595 (+ 833us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.509732 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.511709 (+ 1977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.513073 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.513823 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.514301 (+ 478us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.516719 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.516725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.516737 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.516756 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.521370 (+ 4614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.521926 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.521934 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.521939 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.522062 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.523791 (+ 1729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.523796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.523801 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.524068 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.525029 (+ 961us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.525140 (+ 111us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.525312 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":268,"server-negotiator.queue_time_us":489,"spinlock_wait_cycles":16256,"thread_start_us":124,"threads_started":1}
I20260923 14:45:17.525771 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.513071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53828 (local address 127.17.4.188:35599)
0923 14:45:17.513326 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.513333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.513345 (+ 12us) server_negotiation.cc:407] Connection header received
0923 14:45:17.513378 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.513380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.513417 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.514014 (+ 597us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.514114 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.514843 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.515817 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.516198 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.516632 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.519460 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.519465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.519472 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.519501 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.523032 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.523702 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.523709 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.523713 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.523837 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.524174 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.524177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.524178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.524349 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.525152 (+ 803us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.525210 (+ 58us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.525608 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":256,"server-negotiator.queue_time_us":174,"thread_start_us":98,"threads_started":1}
I20260923 14:45:17.525776 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.508291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.190:46477 (local address 127.0.0.1:45634)
0923 14:45:17.510402 (+ 2111us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.510448 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.510564 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.510879 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.510887 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.511334 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.511565 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.511581 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.512614 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.512617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.513642 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.513652 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.514380 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.514383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.514476 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.515616 (+ 1140us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.515640 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.518186 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.520425 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.520437 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.520448 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.520816 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.521867 (+ 1051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.521873 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.521876 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.522069 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.522754 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.522761 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.523114 (+ 353us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.524411 (+ 1297us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.524708 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1955,"mutex_wait_us":38,"thread_start_us":100,"threads_started":1}
I20260923 14:45:17.528429 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.505849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53812 (local address 127.17.4.188:35599)
0923 14:45:17.506338 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.506357 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.508147 (+ 1790us) server_negotiation.cc:407] Connection header received
0923 14:45:17.508348 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.508353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.508759 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.509027 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.509863 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.511557 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.513776 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.514114 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.514262 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.522173 (+ 7911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.522177 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.522181 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.522205 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.526281 (+ 4076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.526747 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.526752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.526757 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.526842 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.527163 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.527166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.527168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.527356 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.527533 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.528215 (+ 682us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.528314 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":165,"server-negotiator.queue_time_us":330,"thread_start_us":140,"threads_started":1}
I20260923 14:45:17.530319 7781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: Bootstrap starting.
I20260923 14:45:17.530319 7706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: Bootstrap starting.
I20260923 14:45:17.533107 7706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:17.533107 7781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:17.533993 7781 log.cc:824] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:17.533993 7706 log.cc:824] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: Log is configured to *not* fsync() on all Append() calls
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.190@KRBTEST.COM
I20260923 14:45:17.534724 7856 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:17.536398 7706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: No bootstrap required, opened a new log
I20260923 14:45:17.536650 7781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: No bootstrap required, opened a new log
I20260923 14:45:17.538885 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.529458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.17.4.190:46477)
0923 14:45:17.529564 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.529568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.529667 (+ 99us) server_negotiation.cc:407] Connection header received
0923 14:45:17.529832 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.529835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.529874 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.529966 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.530543 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.531032 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.531822 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.532055 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.532164 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.534763 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.534767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.534769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.534793 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.537071 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.537548 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.537551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.537553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.537633 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.537924 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.537927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.537929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.538124 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.538275 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.538628 (+ 353us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.538738 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:45:17.540673 7706 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.540941 7706 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5fae3c70ccd4700ad5fc286325384a7, State: Initialized, Role: FOLLOWER
I20260923 14:45:17.541077 7781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.541275 7781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f990ca5d36742f5b468385a76e8686f, State: Initialized, Role: FOLLOWER
I20260923 14:45:17.541359 7706 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
I20260923 14:45:17.541559 7781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.541895 7866 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.542116 7866 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.542421 7867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.542635 7867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.542735 7706 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:17.542737 7781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: configured and running, proceeding with master startup.
W20260923 14:45:17.543226 7659 tablet.cc:2369] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 14:45:17.546375 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.535271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.189:38129 (local address 127.0.0.1:45450)
0923 14:45:17.535437 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.535450 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.535531 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.535970 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.535974 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.536512 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.537297 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.537304 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.538339 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.538343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.539128 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.539138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.539856 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.539859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.539955 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.540533 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.540549 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.541990 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.544600 (+ 2610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.544604 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.544606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.544897 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.545198 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.545201 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.545204 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.545307 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.545845 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.545848 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.545960 (+ 112us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.546078 (+ 118us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.546214 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260923 14:45:17.546830 7786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.535312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45450 (local address 127.17.4.189:38129)
0923 14:45:17.535416 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.535421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.535492 (+ 71us) server_negotiation.cc:407] Connection header received
0923 14:45:17.535607 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.535613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.535665 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.535735 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.537433 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.538188 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.539261 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.539604 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.539680 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.542163 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.542168 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.542171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.542200 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.544420 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.544986 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.544990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.544991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.545086 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.545424 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.545430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.545435 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.545696 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.545794 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.546580 (+ 786us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.546688 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":38}
W20260923 14:45:17.548674 7888 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:45:17.549265 7888 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.4.189@KRBTEST.COM
W20260923 14:45:17.552222 7889 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:45:17.552347 7889 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:45:17.555395 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.540554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45460 (local address 127.17.4.189:38129)
0923 14:45:17.541216 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.541224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.545122 (+ 3898us) server_negotiation.cc:407] Connection header received
0923 14:45:17.545325 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.545330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.545385 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.545444 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.546420 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.547128 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.548204 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.548542 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.548614 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.551581 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.551584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.551587 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.551611 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.553480 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.553956 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.553959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.553961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.554049 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.554353 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.554357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.554358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.554555 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.554746 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.555115 (+ 369us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.555231 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":127,"threads_started":1}
I20260923 14:45:17.551699 7713 master_runner.cc:186] Error getting master registration for 127.17.4.188:35599: OK, instance_id { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" instance_seqno: 1790174717495016 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 14:45:17.556031 7713 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 14:45:17.554678 7638 master_runner.cc:186] Error getting master registration for 127.17.4.188:35599: OK, instance_id { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" instance_seqno: 1790174717495016 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 14:45:17.558041 7638 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 14:45:17.558360 7856 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } has no permanent_uuid. Determining permanent_uuid...
I20260923 14:45:17.561409 17426 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 14:45:17.562542 7680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c5fae3c70ccd4700ad5fc286325384a7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45636
I20260923 14:45:17.562773 7680 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 14:45:17.562898 7680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 0 FOLLOWER]: Advancing to term 1
Sep 23 14:45:17 dist-test-slave-54kg krb5kdc[7625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790174717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.4.188@KRBTEST.COM for kudu/127.17.4.188@KRBTEST.COM
I20260923 14:45:17.564487 7680 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.565539 7680 leader_election.cc:288] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [CANDIDATE]: Term 1 election: Requested vote from peers 0f990ca5d36742f5b468385a76e8686f (127.17.4.189:38129), 9905d42c51d4431aafa68ec3bb46cc13 (127.17.4.188:35599)
I20260923 14:45:17.566390 7755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c5fae3c70ccd4700ad5fc286325384a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0f990ca5d36742f5b468385a76e8686f"
I20260923 14:45:17.566650 7755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:17.568244 7755 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5fae3c70ccd4700ad5fc286325384a7 in term 1.
I20260923 14:45:17.568746 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.559054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53834 (local address 127.17.4.188:35599)
0923 14:45:17.559162 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.559167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.559181 (+ 14us) server_negotiation.cc:407] Connection header received
0923 14:45:17.559290 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.559293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.559328 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.559416 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.559820 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.560557 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.561657 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.561992 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.562083 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.564802 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.564805 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.564808 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.564830 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.566511 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.567128 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.567131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.567132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.567210 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.567464 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.567467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.567469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.567662 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.567748 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.568473 (+ 725us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.568597 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 14:45:17.569121 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.558984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.4.188:35599 (local address 127.0.0.1:53834)
0923 14:45:17.559105 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0923 14:45:17.559122 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 14:45:17.559199 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 14:45:17.559434 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 14:45:17.559436 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 14:45:17.559600 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0923 14:45:17.559665 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.559669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.560688 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.560691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.561485 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 14:45:17.561494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.562182 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.562185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 14:45:17.562259 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.562834 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 14:45:17.562908 (+ 74us) client_negotiation.cc:656] calling sasl_client_start()
0923 14:45:17.564669 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 14:45:17.566702 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.566705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.566707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.567019 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.567296 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 14:45:17.567298 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 14:45:17.567300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 14:45:17.567368 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 14:45:17.567825 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 14:45:17.567831 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 14:45:17.567918 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 14:45:17.568031 (+ 113us) client_negotiation.cc:240] Negotiation successful
0923 14:45:17.568189 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260923 14:45:17.571329 7657 leader_election.cc:302] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f990ca5d36742f5b468385a76e8686f, c5fae3c70ccd4700ad5fc286325384a7; no voters:
I20260923 14:45:17.571655 7866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 14:45:17.571938 7866 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [term 1 LEADER]: Becoming Leader. State: Replica: c5fae3c70ccd4700ad5fc286325384a7, State: Running, Role: LEADER
I20260923 14:45:17.572320 7866 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.573778 7856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: Bootstrap starting.
I20260923 14:45:17.574496 7866 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5fae3c70ccd4700ad5fc286325384a7. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.574615 7866 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:17.576562 7856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: Neither blocks nor log segments found. Creating new log.
I20260923 14:45:17.577402 7856 log.cc:824] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: Log is configured to *not* fsync() on all Append() calls
I20260923 14:45:17.585428 7901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 14:45:17.586549 7901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 14:45:17.587098 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.570877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45650 (local address 127.17.4.190:46477)
0923 14:45:17.571005 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.571010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.573962 (+ 2952us) server_negotiation.cc:407] Connection header received
0923 14:45:17.574278 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.574283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.574344 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.574402 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.575596 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.576354 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.578274 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.578635 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.578708 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.582451 (+ 3743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.582455 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.582459 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.582490 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.584286 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.585097 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.585100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.585102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.585194 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.585808 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.585812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.585813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.586086 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.586192 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.586836 (+ 644us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.586956 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 14:45:17.589259 7856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: No bootstrap required, opened a new log
I20260923 14:45:17.592468 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.572051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45464 (local address 127.17.4.189:38129)
0923 14:45:17.572163 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.572177 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.576081 (+ 3904us) server_negotiation.cc:407] Connection header received
0923 14:45:17.576238 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.576241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.576300 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.576349 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.577718 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.578505 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.579576 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.580013 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.580127 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.588585 (+ 8458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.588590 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.588596 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.588633 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.590310 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.590787 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.590790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.590792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.590913 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.591224 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.591227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.591228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.591461 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.591598 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.592134 (+ 536us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.592272 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 14:45:17.592787 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:17.572964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53848 (local address 127.17.4.188:35599)
0923 14:45:17.573062 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.573066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.577552 (+ 4486us) server_negotiation.cc:407] Connection header received
0923 14:45:17.579624 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.579628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.579676 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.579723 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.580712 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.581538 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.582614 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:17.582979 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:17.583055 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:17.588749 (+ 5694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 14:45:17.588753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 14:45:17.588756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 14:45:17.588781 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 14:45:17.590832 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.591352 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.591355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.591356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.591443 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 14:45:17.591811 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 14:45:17.591814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 14:45:17.591816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 14:45:17.592044 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 14:45:17.592149 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:17.592487 (+ 338us) server_negotiation.cc:299] Negotiation successful
0923 14:45:17.592608 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 14:45:17.595638 7856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.595947 7856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9905d42c51d4431aafa68ec3bb46cc13, State: Initialized, Role: FOLLOWER
I20260923 14:45:17.596304 7856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } }
I20260923 14:45:17.598809 7856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 14:45:17.598863 7829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c5fae3c70ccd4700ad5fc286325384a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9905d42c51d4431aafa68ec3bb46cc13"
I20260923 14:45:17.599124 7829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [term 0 FOLLOWER]: Advancing to term 1
I20260923 14:45:17.600538 7829 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5fae3c70ccd4700ad5fc286325384a7 in term 1.
I20260923 14:45:17.607185 7829 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [term 1 FOLLOWER]: Refusing update from remote peer c5fae3c70ccd4700ad5fc286325384a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260923 14:45:17.607754 7915 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 14:45:17.607861 7915 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 14:45:17.607923 7897 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:45:17.608088 7904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.608191 7904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.609251 7755 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [term 1 FOLLOWER]: Refusing update from remote peer c5fae3c70ccd4700ad5fc286325384a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 14:45:17.611725 7897 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 14:45:17.612650 7904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5fae3c70ccd4700ad5fc286325384a7. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.612763 7904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.615216 7867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5fae3c70ccd4700ad5fc286325384a7. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.615335 7867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.617733 7866 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.617849 7866 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:17.617987 7867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.618105 7867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.618091 7903 mvcc.cc:205] Tried to move back new op lower bound from 7332555643311833088 to 7332555643180802048. Current Snapshot: MvccSnapshot[applied={T|T < 7332555643311833088}]
I20260923 14:45:17.618336 7919 mvcc.cc:205] Tried to move back new op lower bound from 7332555643311833088 to 7332555643180802048. Current Snapshot: MvccSnapshot[applied={T|T < 7332555643311833088}]
I20260923 14:45:17.631207 7866 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.631327 7866 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7 [sys.catalog]: This master's current role is: LEADER
I20260923 14:45:17.632465 7904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5fae3c70ccd4700ad5fc286325384a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5fae3c70ccd4700ad5fc286325384a7" member_type: VOTER last_known_addr { host: "127.17.4.190" port: 46477 } } peers { permanent_uuid: "0f990ca5d36742f5b468385a76e8686f" member_type: VOTER last_known_addr { host: "127.17.4.189" port: 38129 } } peers { permanent_uuid: "9905d42c51d4431aafa68ec3bb46cc13" member_type: VOTER last_known_addr { host: "127.17.4.188" port: 35599 } } }
I20260923 14:45:17.632568 7904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 14:45:17.635238 7901 catalog_manager.cc:1347] Generated new cluster ID: a618976110314d09b283824a1d2cd536
I20260923 14:45:17.635308 7901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 14:45:17.656635 7901 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 14:45:17.657876 7901 catalog_manager.cc:1504] Loading token signing keys...
I20260923 14:45:17.671316 7901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5fae3c70ccd4700ad5fc286325384a7: Generated new TSK 0
I20260923 14:45:17.672159 7901 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 14:45:17.698882 7710 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.695663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45658 (local address 127.17.4.190:46477)
0923 14:45:17.695814 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.695819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.697746 (+ 1927us) server_negotiation.cc:407] Connection header received
0923 14:45:17.697941 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.697944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.697994 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.698059 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.698708 (+ 649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45658: BlockingRecv error: recv got EOF from 127.0.0.1:45658 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 14:45:17.700511 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.696233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45480 (local address 127.17.4.189:38129)
0923 14:45:17.696345 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.696350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.699459 (+ 3109us) server_negotiation.cc:407] Connection header received
0923 14:45:17.699625 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.699628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.699675 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.699736 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.700399 (+ 663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45480: BlockingRecv error: recv got EOF from 127.0.0.1:45480 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260923 14:45:17.701869 7859 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.697170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53860 (local address 127.17.4.188:35599)
0923 14:45:17.697279 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.697283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.700989 (+ 3706us) server_negotiation.cc:407] Connection header received
0923 14:45:17.701179 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.701183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.701231 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.701280 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.701746 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53860: BlockingRecv error: recv got EOF from 127.0.0.1:53860 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260923 14:45:17.705981 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.704593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45492 (local address 127.17.4.189:38129)
0923 14:45:17.704691 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.704695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.705109 (+ 414us) server_negotiation.cc:407] Connection header received
0923 14:45:17.705313 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.705317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.705385 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.705434 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.705890 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45492: BlockingRecv error: recv got EOF from 127.0.0.1:45492 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260923 14:45:17.710610 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.709276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45502 (local address 127.17.4.189:38129)
0923 14:45:17.709368 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.709372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.709832 (+ 460us) server_negotiation.cc:407] Connection header received
0923 14:45:17.709992 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.709995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.710050 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.710096 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.710523 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45502: BlockingRecv error: recv got EOF from 127.0.0.1:45502 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260923 14:45:17.716252 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.714705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45508 (local address 127.17.4.189:38129)
0923 14:45:17.714801 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.714806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.715276 (+ 470us) server_negotiation.cc:407] Connection header received
0923 14:45:17.715451 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.715454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.715499 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.715549 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.716161 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45508: BlockingRecv error: recv got EOF from 127.0.0.1:45508 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260923 14:45:17.723858 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.722270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45512 (local address 127.17.4.189:38129)
0923 14:45:17.722391 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.722395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.722872 (+ 477us) server_negotiation.cc:407] Connection header received
0923 14:45:17.723062 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.723066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.723118 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.723171 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.723689 (+ 518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45512: BlockingRecv error: recv got EOF from 127.0.0.1:45512 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 14:45:17.735623 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.733955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45522 (local address 127.17.4.189:38129)
0923 14:45:17.734082 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.734088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.734637 (+ 549us) server_negotiation.cc:407] Connection header received
0923 14:45:17.734881 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.734884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.734938 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.734991 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.735518 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45522: BlockingRecv error: recv got EOF from 127.0.0.1:45522 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260923 14:45:17.755553 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.753820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45526 (local address 127.17.4.189:38129)
0923 14:45:17.753934 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.753939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.754537 (+ 598us) server_negotiation.cc:407] Connection header received
0923 14:45:17.754754 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.754757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.754811 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.754868 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.755438 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45526: BlockingRecv error: recv got EOF from 127.0.0.1:45526 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260923 14:45:17.791198 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.790094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45538 (local address 127.17.4.189:38129)
0923 14:45:17.790241 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.790246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.790359 (+ 113us) server_negotiation.cc:407] Connection header received
0923 14:45:17.790429 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.790432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.790494 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.790600 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.791058 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45538: BlockingRecv error: recv got EOF from 127.0.0.1:45538 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260923 14:45:17.858585 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.857346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45542 (local address 127.17.4.189:38129)
0923 14:45:17.857526 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.857532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.857672 (+ 140us) server_negotiation.cc:407] Connection header received
0923 14:45:17.857851 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.857855 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.857912 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.858003 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.858458 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45542: BlockingRecv error: recv got EOF from 127.0.0.1:45542 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260923 14:45:17.990000 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:17.988745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45550 (local address 127.17.4.189:38129)
0923 14:45:17.988931 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:17.988936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:17.989075 (+ 139us) server_negotiation.cc:407] Connection header received
0923 14:45:17.989267 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:17.989270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:17.989328 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:17.989418 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:17.989879 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45550: BlockingRecv error: recv got EOF from 127.0.0.1:45550 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260923 14:45:18.249179 7865 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 14:45:18.247984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45556 (local address 127.17.4.189:38129)
0923 14:45:18.248135 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:18.248140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:18.248245 (+ 105us) server_negotiation.cc:407] Connection header received
0923 14:45:18.248419 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:18.248423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:18.248481 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:18.248600 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 14:45:18.249057 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45556: BlockingRecv error: recv got EOF from 127.0.0.1:45556 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 14:45:18.552959 7888 catalog_manager.cc:1259] Loaded cluster ID: a618976110314d09b283824a1d2cd536
I20260923 14:45:18.553089 7888 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: loading cluster ID for follower catalog manager: success
I20260923 14:45:18.555112 7888 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: acquiring CA information for follower catalog manager: success
I20260923 14:45:18.556802 7888 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f990ca5d36742f5b468385a76e8686f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 14:45:18.609113 7915 catalog_manager.cc:1259] Loaded cluster ID: a618976110314d09b283824a1d2cd536
I20260923 14:45:18.609184 7915 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: loading cluster ID for follower catalog manager: success
I20260923 14:45:18.610769 7915 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: acquiring CA information for follower catalog manager: success
I20260923 14:45:18.612030 7915 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9905d42c51d4431aafa68ec3bb46cc13: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 14:45:18.766860 7989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:18.763199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.17.4.189:38129)
0923 14:45:18.763434 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:18.763438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:18.763454 (+ 16us) server_negotiation.cc:407] Connection header received
0923 14:45:18.763603 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:18.763606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:18.763729 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:18.763842 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:18.764087 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.764600 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.765431 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.765676 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.765765 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:18.766055 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:18.766498 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:18.766591 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:18.766678 (+ 87us) server_negotiation.cc:299] Negotiation successful
0923 14:45:18.766727 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260923 14:45:18.773243 7995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:18.769952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53872 (local address 127.17.4.188:35599)
0923 14:45:18.770187 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:18.770191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:18.770204 (+ 13us) server_negotiation.cc:407] Connection header received
0923 14:45:18.770281 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:18.770283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:18.770387 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:18.770488 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:18.770685 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.771178 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.772035 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.772255 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.772331 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:18.772566 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:18.772942 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:18.773029 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:18.773085 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 14:45:18.773130 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":76,"threads_started":1}
I20260923 14:45:18.779635 7995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:18.776421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53880 (local address 127.17.4.188:35599)
0923 14:45:18.776529 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:18.776532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:18.776578 (+ 46us) server_negotiation.cc:407] Connection header received
0923 14:45:18.776684 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:18.776686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:18.776720 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:18.776778 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:18.777056 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.777641 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.778632 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.778852 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.778983 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:18.779232 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:18.779322 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:18.779393 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:18.779460 (+ 67us) server_negotiation.cc:299] Negotiation successful
0923 14:45:18.779506 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 14:45:18.780735 7989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:18.776033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45572 (local address 127.17.4.189:38129)
0923 14:45:18.776146 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:18.776151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:18.776339 (+ 188us) server_negotiation.cc:407] Connection header received
0923 14:45:18.777170 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:18.777173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:18.777227 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:18.777318 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:18.777576 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.778104 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.779363 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.779722 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.779857 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:18.780235 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:18.780339 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:18.780400 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:18.780555 (+ 155us) server_negotiation.cc:299] Negotiation successful
0923 14:45:18.780607 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260923 14:45:18.781534 8002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 14:45:18.775950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45668 (local address 127.17.4.190:46477)
0923 14:45:18.776510 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0923 14:45:18.776516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 14:45:18.776533 (+ 17us) server_negotiation.cc:407] Connection header received
0923 14:45:18.776629 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 14:45:18.776635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 14:45:18.776805 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 14:45:18.776921 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 14:45:18.777426 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.778219 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.779915 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 14:45:18.780233 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 14:45:18.780590 (+ 357us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 14:45:18.780746 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 14:45:18.781089 (+ 343us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 14:45:18.781166 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 14:45:18.781282 (+ 116us) server_negotiation.cc:299] Negotiation successful
0923 14:45:18.781356 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":94,"threads_started":1}
I20260923 14:45:18.784072 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7638
I20260923 14:45:18.790504 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7713
I20260923 14:45:18.796653 17426 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUR6fzw/build/debug/bin/kudu with pid 7787
2026-09-23T14:45:18Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3159 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6252 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (281914 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST